-- Logs begin at Wed 2022-08-24 15:03:26 UTC, end at Wed 2022-08-24 16:37:16 UTC. -- Aug 24 15:38:09.629638 dv-cinder-849325-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 15:38:09.640368 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:38:09 2022] *** Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: nodename: dv-cinder-849325-3-iscsi Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: machine: x86_64 Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: clock source: unix Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: pcre jit disabled Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: detected number of CPU cores: 4 Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: current working directory: / Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: your processes number limit is 47680 Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: your memory page size is 4096 bytes Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: detected max file descriptor number: 2048 Aug 24 15:38:09.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: lock engine: pthread robust mutexes Aug 24 15:38:09.643310 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: thunder lock: enabled Aug 24 15:38:09.643310 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 15:38:09.643310 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:38:09.685587 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: Python main interpreter initialized at 0x555a07f639c0 Aug 24 15:38:09.685587 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: python threads support enabled Aug 24 15:38:09.685587 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: your server socket listen backlog is limited to 100 connections Aug 24 15:38:09.685587 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:38:09.686025 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:38:09.686025 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: *** Operational MODE: preforking *** Aug 24 15:38:09.686306 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:38:09.686306 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: spawned uWSGI master process (pid: 117473) Aug 24 15:38:09.686518 dv-cinder-849325-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 15:38:09.687382 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: spawned uWSGI worker 1 (pid: 117487, cores: 1) Aug 24 15:38:09.687544 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: spawned uWSGI worker 2 (pid: 117488, cores: 1) Aug 24 15:38:09.687681 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:38:10.363185 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:38:10.383121 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:38:11.463330 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:38:11.463330 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: from cryptography.utils import int_from_bytes Aug 24 15:38:11.464058 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:38:11.464058 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: from cryptography.utils import int_from_bytes Aug 24 15:38:11.482885 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:38:11.482885 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: from cryptography.utils import int_from_bytes Aug 24 15:38:11.483429 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:38:11.483429 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: from cryptography.utils import int_from_bytes Aug 24 15:38:14.027604 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:38:14.028215 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:38:14.028462 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:38:14.028828 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:38:14.029081 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:38:14.029524 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.029852 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.030174 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.030508 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.030825 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.031135 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.031296 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:38:14.031693 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.031777 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:38:14.031866 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.032123 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:38:14.032220 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.032394 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.032525 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:38:14.032705 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.032787 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:38:14.033028 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-3-iscsi {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.033337 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.033431 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.033649 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.033760 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.033956 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.034114 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.034273 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.034435 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.034565 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.034802 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.034911 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.035172 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.035274 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.035608 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.035732 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.035960 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.036158 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.036288 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.036452 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.036572 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.036765 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.036886 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.037104 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.037233 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-3-iscsi {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.037415 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.037518 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.037767 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.037907 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.038086 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.038208 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.038394 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.038619 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.038743 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.038925 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.039037 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.039255 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.039396 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-3-iscsi {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.039552 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.039742 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.040040 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.040138 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.040349 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.040435 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.040677 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.041398 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.041588 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.041773 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042009 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042096 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042328 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042425 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042641 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042750 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.042971 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.043100 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.043274 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.043381 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.043602 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.043804 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.043937 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044048 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044238 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044457 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-3-iscsi {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044594 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044698 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044826 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.044935 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.045137 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.045270 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.045454 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.045614 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.045775 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.045925 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046037 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046237 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046362 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046559 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046672 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046881 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.046971 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.047188 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.047274 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.047508 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.047610 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.047831 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.047950 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.048084 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.048239 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.048384 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.048529 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.048748 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.048908 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.049036 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.049133 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.049342 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.049428 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.049898 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.049990 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.050203 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.050288 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.050508 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.050591 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.050756 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.050840 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.051066 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.051150 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.051389 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.051517 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.051737 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.051864 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052056 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052195 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052313 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052408 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052565 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052657 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052885 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.052971 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.053208 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.053355 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.053517 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.053601 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.053844 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.053983 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.054133 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.054226 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.054439 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.054523 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.054746 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.054839 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.055054 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.055139 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.055361 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.055453 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.055713 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.055839 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.056022 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.056111 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.056355 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.057168 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.057257 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.057567 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.057875 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.057978 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.058129 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.058225 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.058431 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.058548 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.058738 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.058964 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.059053 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.059225 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.059354 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.059543 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.059643 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.059918 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060005 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060241 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060323 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060546 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060631 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060852 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.060937 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.061156 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.061240 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.061459 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.061553 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.061835 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.061943 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062153 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062372 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062499 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062675 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062774 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.062978 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.063071 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.063261 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.063344 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.063568 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.063699 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.063910 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064015 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064211 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064294 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064515 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064613 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064816 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.064909 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.065134 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.065235 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.065425 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.065508 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.065728 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.065826 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066103 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066213 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066335 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066426 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066635 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066729 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.066941 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067036 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067246 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067339 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067546 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067697 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067884 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.067980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.068183 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.068267 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.068487 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.068587 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.068803 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.068896 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.069106 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.069193 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.069408 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.069493 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.069707 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.069790 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070014 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070162 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070306 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070392 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070608 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070692 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070908 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.070993 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.071208 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.071293 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.071506 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.071594 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.071838 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.071933 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.072241 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.072337 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.072551 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.072635 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.072855 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.072972 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.073159 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.073300 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.073477 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.073605 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.073817 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.073914 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.074149 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.074233 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.074493 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.074584 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.074808 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.074909 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.075141 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.075228 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.075496 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.075778 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.075879 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.076119 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.076299 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.076514 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.076622 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.076743 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.076935 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.077054 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.077252 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.077363 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.077568 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.077660 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.077894 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.077980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.078222 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.078307 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.078535 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.078627 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.078844 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.078930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.079155 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.079239 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.079480 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:38:14.079565 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.079853 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.079960 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.080160 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.080244 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.080492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.080576 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.080817 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.080908 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.081126 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.081209 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.081476 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.081571 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.081798 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.081946 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.082114 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.082247 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.082431 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.082523 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.082758 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.082853 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.083073 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.083158 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.083381 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.083475 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.083714 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.083807 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084034 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084118 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084353 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084448 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084678 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084805 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.084978 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.085065 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.085289 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.085387 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.085601 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.085687 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.085911 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086221 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086317 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086531 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086617 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086861 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.086945 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.087175 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.087260 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.087490 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.087596 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.087879 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.088113 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.088216 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.088498 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.088597 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.088906 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.088993 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.089206 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.089306 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.089510 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.089610 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.089815 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.089900 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.090122 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.090229 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.090532 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.090625 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.090726 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.090811 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.091045 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.091131 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.091376 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.091483 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093088 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093242 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093358 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093441 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093518 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093602 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093687 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093770 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093856 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.093934 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094011 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094011 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094149 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094225 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094310 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094432 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094517 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094593 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094669 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094745 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094831 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.094986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.095072 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.095288 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.095383 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.095608 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.095806 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.095936 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096037 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096241 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096372 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096547 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096645 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096854 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.096944 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.097161 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.097254 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.097469 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.097556 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.097781 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.097874 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.098090 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.098176 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.098401 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.098494 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.098709 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.098794 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099021 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099111 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099335 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099470 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099664 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099752 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.099972 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100080 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100286 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100375 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100599 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100682 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100902 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.100996 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.101210 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.101295 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.101511 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.101595 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.101814 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.101908 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.102214 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.102311 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.102421 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.102507 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.102721 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.102809 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.103022 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.103119 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.103888 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.104001 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.104204 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.104429 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.104504 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.104844 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.104955 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105079 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105352 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105445 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105659 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105752 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.105966 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.106064 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.106268 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.106374 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.106612 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.106706 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.106919 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.107005 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.107263 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.107347 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.107598 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.107767 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.107938 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108026 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108252 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108336 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108559 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108652 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108865 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.108951 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.109171 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.109264 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.109480 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.109572 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.109782 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.109867 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110087 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110173 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110395 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110533 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110707 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110862 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.110985 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.111165 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.111335 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.111499 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.111711 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.111928 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112058 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112142 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112217 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112292 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112492 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112579 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112828 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.112912 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.113131 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.113224 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.113477 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.113562 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.113789 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.113872 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.114110 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.114197 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.114419 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.114503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.114732 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.114867 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.115022 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.115110 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.115333 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.115422 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.115654 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.115744 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.116010 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.116132 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.116285 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.116410 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.116589 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.116686 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117003 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117111 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117210 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117292 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117519 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117697 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117820 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.117895 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.118136 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.118210 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.118436 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.118519 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.118746 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.119515 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.119683 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.119971 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.120173 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.120319 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.120404 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.120630 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.120704 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.120949 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121034 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121255 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121350 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121569 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121656 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121878 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.121999 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.122180 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.122368 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.122483 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.122718 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.122824 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.123086 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.123185 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.123390 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.123475 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.123724 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.123812 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124030 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124119 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124341 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124433 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124647 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124731 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.124949 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.125092 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.125248 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.125437 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.125555 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.125785 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.125946 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.126101 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.126186 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127092 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127207 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127285 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127364 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127364 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127580 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127740 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127837 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.127918 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128059 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128143 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128259 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128401 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128560 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128715 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.128859 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129032 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129203 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129340 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129514 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129647 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129814 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.129957 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.130128 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.130274 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.130445 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.130587 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.130750 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.130898 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.131063 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.131206 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.131368 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.131521 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.131725 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.131859 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.132032 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.132170 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.132338 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.132472 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.132647 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133329 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133419 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133507 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133594 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133680 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133758 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133843 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.133926 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134012 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134133 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134297 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134439 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134631 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134775 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.134956 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.135079 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.135350 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.135437 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.135579 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.135694 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.135912 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.136001 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.136216 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.136562 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.136646 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.136876 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.136962 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.137181 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.137265 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.137494 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.137579 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.137812 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.137898 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.138120 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.138204 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.138436 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.138531 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.138745 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.138830 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.139057 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.139140 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.139368 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.139466 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.139695 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.139788 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140032 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140130 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140303 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140389 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140610 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140697 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140909 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.140992 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.141212 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.141309 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.141516 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.141604 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.141820 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.141911 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.142120 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.142205 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.142419 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.142506 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.142773 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.142875 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.143081 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.143172 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.143316 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.143403 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.143617 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.143930 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144033 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144231 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144317 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144553 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144646 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144859 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.144945 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.145160 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.145247 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.145465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.145605 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.145767 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.145857 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.146104 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.146204 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.146404 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.146490 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.146729 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.146822 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147039 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147132 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147342 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147427 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147674 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147763 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.147980 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148068 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148286 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148374 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148588 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148671 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.148981 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.149188 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.149272 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.149489 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.149574 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.149793 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.149891 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.150615 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.150770 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.150926 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151005 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151236 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151376 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151534 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151617 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151864 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.151959 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.152165 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.152252 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.152470 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.152554 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.152771 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.152868 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153213 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153467 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153672 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153771 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.153972 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154066 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154279 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154364 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154585 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154682 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154885 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.154970 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.155189 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.155282 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.155487 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.155703 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.155827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.155913 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.156131 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.156215 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.156430 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.156517 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.156730 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.156815 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157037 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157166 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157343 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157436 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157641 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157725 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.157963 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158045 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158267 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158358 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158569 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158668 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158869 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.158962 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.159175 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.159258 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.159474 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.159565 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.159796 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.159906 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.160105 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.160196 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.160422 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.160508 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.160732 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.160824 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161031 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161122 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161332 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161415 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161629 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161725 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.161947 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162050 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162232 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162317 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162534 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162619 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162834 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.162918 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.163192 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.163395 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.163490 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.163668 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.163770 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.163846 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164026 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164112 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164344 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164430 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164649 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164737 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.164950 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.165034 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.165248 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.165340 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.165544 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.165636 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.166521 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.166707 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.166899 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.166973 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.167211 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.167598 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.167816 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.167940 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.168149 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.168244 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.168474 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.168570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.168792 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.168888 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.169210 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.169303 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.169530 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.169615 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.169850 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.169944 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.170162 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.170312 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.170465 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.170556 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.170778 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.170886 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.171083 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.171168 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.171386 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.171470 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.171726 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.171844 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172054 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172152 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172368 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172489 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172899 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.172984 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.173324 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.173629 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.173784 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.173874 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.173954 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.174037 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.174202 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.174289 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.174508 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.174889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.175068 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.175222 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.175374 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.175653 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.175762 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176002 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176096 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176409 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176621 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176728 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.176927 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177014 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177235 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177320 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177539 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177666 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177845 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.177939 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.178146 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.178239 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.178448 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.178542 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.178759 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.178834 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179063 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179137 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179369 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179453 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179743 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179841 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.179991 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.180069 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.180297 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.180375 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.180599 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.180682 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.180939 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.181041 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.181276 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.181435 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.181742 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.181824 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182042 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182129 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182348 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182425 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182656 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182741 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.182966 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.183057 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.183276 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.183362 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.183602 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.183704 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.183915 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184019 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184220 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184314 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184535 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184627 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184846 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.184939 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.185154 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.185229 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.185464 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.185547 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.185772 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.185856 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186076 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186156 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186380 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186454 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186720 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186810 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.186977 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.187052 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.187292 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.187376 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.187726 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.187828 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.187931 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.188006 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.188236 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.188415 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.188674 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.188751 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.188988 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.189063 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.189298 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.189416 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.189603 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.189728 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190022 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190106 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190344 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190448 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190657 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190749 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.190974 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.191059 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.191279 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.191373 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.191591 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.191710 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.191922 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192009 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192245 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192338 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192567 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192651 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192876 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.192979 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.193261 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.193489 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.193489 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.193703 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.193923 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194014 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194102 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194180 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194392 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194477 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194694 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.194778 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.195016 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.195197 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.195320 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.195407 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.195656 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.195785 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.196068 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.196187 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.196358 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.196473 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.196830 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.197108 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.197329 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.197536 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.197659 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.197782 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.197897 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198007 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198116 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198202 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198294 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198564 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198649 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198875 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.198950 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.199185 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.199262 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.199495 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.199681 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.199822 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.200057 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.200147 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.200433 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.200507 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.200739 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.200848 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.201063 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.201245 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.201379 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.201622 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.201696 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.201973 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.202077 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.202291 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.202427 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.202612 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.202763 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.202919 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.203083 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.203220 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.203416 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.203505 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.203831 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.203919 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.204174 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.204262 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.204476 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.204562 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.204794 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.204886 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.205120 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.205206 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.205436 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.205567 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.205742 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.205833 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206054 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206148 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206363 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206447 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206672 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206766 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.206986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.207085 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.207295 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.207390 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.207598 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.207768 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.207929 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208024 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208238 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208323 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208540 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208678 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208842 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.208926 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.209141 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.209227 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.209446 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.209545 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.209746 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.209832 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210045 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210131 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210344 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210431 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210662 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210746 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.210961 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.211054 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.211288 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.211375 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.211593 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.211709 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.211919 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.212027 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.212219 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.212365 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.212518 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.213239 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.213597 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.213777 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.213920 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.213997 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.214312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.214413 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.214565 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.214733 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.214893 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.215069 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.215211 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.215385 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.215526 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.215749 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.215866 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.216084 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.216183 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.216407 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.216493 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.216730 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.216817 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217066 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217185 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217374 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217460 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217683 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217790 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.217992 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.218097 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.218294 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.218388 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.218601 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.218860 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.218951 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.219187 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.219275 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.219496 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.219590 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.219827 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.219924 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.220136 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.220221 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.220448 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.220542 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.220751 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.220836 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221058 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221189 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221368 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221451 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221664 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221749 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.221966 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222063 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222270 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222356 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222597 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222696 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222903 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.222998 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.223235 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.223328 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.223547 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.223684 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.223889 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224028 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224196 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224295 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224507 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224602 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224819 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.224905 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.225132 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.225217 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.225448 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.225542 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.225760 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.225846 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226069 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226154 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226379 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226464 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226687 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226774 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.226996 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.227088 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.227305 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.227424 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.227618 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.227895 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.228005 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.228266 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.228922 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.229101 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.229179 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.229414 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.229511 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.229729 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.229869 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230046 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230146 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230362 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230456 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230671 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230770 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.230980 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.231065 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.231290 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.231374 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.231598 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.231843 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.231968 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.232162 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.232296 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.232497 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.232634 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.232826 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.232969 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.233151 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.233288 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.233469 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.233622 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.233786 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.233918 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.234312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.234410 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.234617 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.234725 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.234808 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.234887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.235104 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.235190 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.235415 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.235501 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.235755 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.235883 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.236100 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.236188 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.236449 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.236543 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.236755 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.236841 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.237076 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.237163 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.237386 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.237473 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.237695 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.237930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.238046 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.238278 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.238394 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.238594 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.238690 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.238921 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.239029 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.239249 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.239376 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.239566 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.239676 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.239922 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.240046 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.240238 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.240766 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.240766 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.240925 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241051 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241137 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241229 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241387 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241483 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241726 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.241813 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.242055 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.242152 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.242390 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.242477 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.242700 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.242787 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.243006 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.243102 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.243334 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.243431 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.243660 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.243768 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.244032 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.244140 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.244480 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.244590 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.244710 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.244874 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245015 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245203 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245325 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245530 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245617 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245845 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.245947 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.246153 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.246240 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.246477 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.246565 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.246786 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.246873 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.247088 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.247320 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.247420 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.247691 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.247795 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248023 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248151 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248309 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248405 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248613 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248714 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.248914 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249008 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249235 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249374 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249537 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249638 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249848 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.249933 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.250273 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.250375 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.250466 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.250554 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.250773 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.250862 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.251077 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.251163 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.251382 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.251481 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.251719 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.251824 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.252110 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.252213 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.252346 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.252597 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.252684 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253036 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253146 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253255 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253341 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253562 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253648 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.253910 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.254046 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.254218 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.254343 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.254588 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.254766 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.254928 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.255082 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.255263 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.255412 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.255573 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.255741 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.255910 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.256052 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.256225 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.256366 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.256618 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.256706 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.256962 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.257057 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.257301 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.257410 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.257642 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.257732 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.257957 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.258062 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.258270 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.258366 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.258594 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.258684 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.258913 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.259020 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.259215 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.259316 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.259555 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.259742 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.259923 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.260030 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.260268 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.260361 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.260624 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.260717 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.260946 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.261048 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.261262 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.261363 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.261577 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.261698 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.261895 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.262082 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.262235 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.262550 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.262659 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.262858 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.262971 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.263163 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.263297 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.263846 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.264198 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.264665 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.264770 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.264862 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.264942 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.264942 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.265146 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.265293 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.265473 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.265944 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266063 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266308 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266379 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266455 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266543 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266877 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.266972 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267052 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267129 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267217 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267296 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267373 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267449 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267525 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267615 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267767 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.267905 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268005 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268166 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268253 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268490 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268576 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268801 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.268887 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.269111 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.269196 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.269419 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.269505 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.269724 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.269809 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270027 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270123 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270335 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270439 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270654 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270746 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.270960 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.271056 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.271261 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.271347 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.271560 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.271681 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.271899 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272019 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272202 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272298 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272504 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272591 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272804 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.272892 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.273105 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.273198 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.273409 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.273495 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.273708 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.273796 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274008 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274139 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274307 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274452 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274606 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274773 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.274904 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.275614 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.275864 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.275997 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276090 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276256 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276340 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276584 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276672 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276894 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.276983 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.277192 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.277278 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.277492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.277579 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.277823 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.277929 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.278150 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.278245 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.278460 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.278602 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.278781 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.278869 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.279084 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.279173 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.279389 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.279485 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.279716 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.279805 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280037 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280120 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280346 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280441 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280653 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280741 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.280958 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281048 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281267 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281432 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281576 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281662 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281880 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.281965 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.282181 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.282274 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.282484 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.282571 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.282783 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.282869 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.283088 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.283175 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.283387 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.283472 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.283713 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.283800 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284021 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284109 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284324 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284414 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284629 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284708 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.284932 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285026 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285239 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285325 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285542 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285648 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285842 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.285929 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.286142 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.286228 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.286445 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.286538 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.286744 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.286829 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.287047 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.287139 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.287354 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.287449 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.287690 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.287793 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288020 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288112 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288307 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288396 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288656 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288753 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.288923 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289017 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289241 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289328 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289562 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289648 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289871 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.289956 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.290179 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.290276 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.290529 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.290633 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.291422 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.291574 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.291756 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.291917 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.292200 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.292289 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.292514 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.292623 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.292823 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.292958 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.293135 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.293241 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.293465 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.293564 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.293722 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:38:14.293807 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.294087 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.294415 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.294737 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.295052 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.295368 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.295717 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.296151 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.296365 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.296676 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.296986 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.297296 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.297603 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.297919 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.298228 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.298537 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.298852 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.299168 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.299498 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.300115 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.300432 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.300757 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.301087 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.301436 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.301751 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.302098 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.302429 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.302746 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.303058 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.303364 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:38:14.303608 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:38:14.449269 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO dbcounter [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Registered counter for database nova_api Aug 24 15:38:14.463881 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO dbcounter [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Registered counter for database nova_api Aug 24 15:38:14.471204 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_db.sqlalchemy.engines [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.477816 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writer thread running {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.484609 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.491212 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writer thread running {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.534905 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.context [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4c1394e-0d00-43a6-95ee-abb5457791d3(cell1) {{(pid=117488) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:38:14.538793 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:14.539261 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:14.541482 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:14.542207 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:14.542650 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:14.544660 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:14.546642 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO dbcounter [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Registered counter for database nova_cell0 Aug 24 15:38:14.549503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.context [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4c1394e-0d00-43a6-95ee-abb5457791d3(cell1) {{(pid=117487) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:38:14.552504 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO dbcounter [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Registered counter for database nova_cell1 Aug 24 15:38:14.553686 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_concurrency.lockutils [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:14.554162 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_concurrency.lockutils [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:14.555777 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_concurrency.lockutils [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:14.557174 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_concurrency.lockutils [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:14.557629 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_concurrency.lockutils [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:14.559799 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_concurrency.lockutils [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:14.561249 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_db.sqlalchemy.engines [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.561966 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO dbcounter [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Registered counter for database nova_cell0 Aug 24 15:38:14.562949 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_db.sqlalchemy.engines [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.567525 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO dbcounter [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Registered counter for database nova_cell1 Aug 24 15:38:14.568588 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writer thread running {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.571363 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writer thread running {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.575154 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.578951 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.580812 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writer thread running {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.717671 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO dbcounter [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Registered counter for database nova_cell0 Aug 24 15:38:14.726789 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writer thread running {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.726984 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_db.sqlalchemy.engines [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.731755 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writer thread running {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:14.736224 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO dbcounter [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Registered counter for database nova_cell0 Aug 24 15:38:14.745516 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:38:14.749892 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writer thread running {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:38:15.079324 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: WARNING keystonemiddleware.auth_token [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:38:15.086116 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: WARNING keystonemiddleware.auth_token [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:38:15.086584 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: WARNING keystonemiddleware.auth_token [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:38:15.093637 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: WARNING keystonemiddleware.auth_token [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:38:15.431180 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: WARNING keystonemiddleware.auth_token [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:38:15.437942 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: WARNING keystonemiddleware.auth_token [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:38:15.443165 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a07f639c0 pid: 117488 (default app) Aug 24 15:38:15.445275 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:15.446443 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] 10.222.0.102 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001736 Aug 24 15:38:15.446852 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 1/1] 10.222.0.102 () {50 vars in 793 bytes} [Wed Aug 24 15:38:15 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:15.450717 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: WARNING keystonemiddleware.auth_token [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:38:15.459162 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: WARNING keystonemiddleware.auth_token [None req-6fd48a66-d45e-4e59-9319-5c7b66caf935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:38:15.465098 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a07f639c0 pid: 117487 (default app) Aug 24 15:39:36.618337 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:36.619487 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001580 Aug 24 15:39:36.620305 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 2/2] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:36 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:36.637577 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_api:SELECT=3 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:36.638682 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_cell0:SELECT=3 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:36.639872 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_cell1:SELECT=3 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:36.643334 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_cell0:SELECT=3 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:37.604073 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c5e76c83-599d-418b-b31d-31beb3b740ac admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:37.637210 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c5e76c83-599d-418b-b31d-31beb3b740ac admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.009583 Aug 24 15:39:37.639656 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 1/3] 10.222.0.102 () {60 vars in 1297 bytes} [Wed Aug 24 15:39:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:40.063226 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:40.064273 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-afa4e32a-d3fd-4e89-bb84-6fdc04d196f1 None None] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001500 Aug 24 15:39:40.064843 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 3/4] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:40 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:40.551206 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-a6e3e69b-432a-42e0-aacd-6d972830d2e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:40.574839 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:39:40.574839 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: warnings.warn(msg) Aug 24 15:39:40.609651 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-a6e3e69b-432a-42e0-aacd-6d972830d2e5 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.537769 Aug 24 15:39:40.610942 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 2/5] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:39:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:39:40.626882 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_api:SELECT=3 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:40.628470 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_cell0:SELECT=3 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:40.629832 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_cell1:SELECT=3 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:40.631316 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:40.859102 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-b5ccb0a1-91b7-4f71-a810-4f3f1f0e078d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:40.863496 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:39:40.863496 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: warnings.warn(msg) Aug 24 15:39:40.926438 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-b5ccb0a1-91b7-4f71-a810-4f3f1f0e078d admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305842 Aug 24 15:39:40.927027 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 4/6] 10.222.0.102 () {64 vars in 1341 bytes} [Wed Aug 24 15:39:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:43.339664 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-a6e3e69b-432a-42e0-aacd-6d972830d2e5 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:43.341007 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-a6e3e69b-432a-42e0-aacd-6d972830d2e5 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001809 Aug 24 15:39:43.341644 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 3/7] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:43 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:44.033529 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-eee3ff4d-5507-4b5f-ae84-9266afd08056 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:44.054029 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:39:44.054029 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: warnings.warn(msg) Aug 24 15:39:44.073960 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-eee3ff4d-5507-4b5f-ae84-9266afd08056 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.726026 Aug 24 15:39:44.074770 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 5/8] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:39:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:39:44.087762 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-a0777454-d7f5-4e37-9220-7c68fa1a694b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:44.091062 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:39:44.091062 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: warnings.warn(msg) Aug 24 15:39:44.130550 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-a0777454-d7f5-4e37-9220-7c68fa1a694b admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047299 Aug 24 15:39:44.132204 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 4/9] 10.222.0.102 () {64 vars in 1341 bytes} [Wed Aug 24 15:39:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:46.589164 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-eee3ff4d-5507-4b5f-ae84-9266afd08056 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:46.590167 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-eee3ff4d-5507-4b5f-ae84-9266afd08056 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001473 Aug 24 15:39:46.590560 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 6/10] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:46 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:46.999169 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-82a25a7c-ddbc-41e5-b114-fd748a35e738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:47.018418 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-82a25a7c-ddbc-41e5-b114-fd748a35e738 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.421635 Aug 24 15:39:47.018900 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 5/11] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:39:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:39:47.031710 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-6da8ed8e-217a-4395-8f8d-fcadbab07b06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:47.060365 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-6da8ed8e-217a-4395-8f8d-fcadbab07b06 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032518 Aug 24 15:39:47.060968 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 7/12] 10.222.0.102 () {64 vars in 1341 bytes} [Wed Aug 24 15:39:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:49.449992 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-82a25a7c-ddbc-41e5-b114-fd748a35e738 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:49.451585 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-82a25a7c-ddbc-41e5-b114-fd748a35e738 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002086 Aug 24 15:39:49.452429 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 6/13] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:49 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:49.909868 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-2509530a-77d6-4116-a064-2a48250c1f58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "name": "ds2G", "id": "d3", "vcpus": 2}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:49.929752 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-2509530a-77d6-4116-a064-2a48250c1f58 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470103 Aug 24 15:39:49.937519 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 8/14] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:39:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:39:49.942101 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-137de633-581a-4f39-bc3e-5aa04aa3e1eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:49.968162 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-137de633-581a-4f39-bc3e-5aa04aa3e1eb admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029582 Aug 24 15:39:49.968821 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 7/15] 10.222.0.102 () {64 vars in 1341 bytes} [Wed Aug 24 15:39:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:52.373739 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-2509530a-77d6-4116-a064-2a48250c1f58 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:52.374676 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-2509530a-77d6-4116-a064-2a48250c1f58 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001526 Aug 24 15:39:52.375282 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 9/16] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:52 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:52.837770 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-74a53435-8dd8-420a-ac72-9e7b3da9826a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "ram": 4096}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:52.862163 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-74a53435-8dd8-420a-ac72-9e7b3da9826a admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479672 Aug 24 15:39:52.862976 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 8/17] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:39:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:39:52.875218 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-94efbe63-619a-4703-a62b-a6dc34101c0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:52.904051 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-94efbe63-619a-4703-a62b-a6dc34101c0b admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032548 Aug 24 15:39:52.914986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 10/18] 10.222.0.102 () {64 vars in 1341 bytes} [Wed Aug 24 15:39:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:55.677771 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-74a53435-8dd8-420a-ac72-9e7b3da9826a admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:55.679459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-74a53435-8dd8-420a-ac72-9e7b3da9826a admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002084 Aug 24 15:39:55.679902 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 9/19] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:55 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:56.143955 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-68ac6a9e-dfcc-497c-ab73-e93a7dcf4b08 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:56.171448 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-68ac6a9e-dfcc-497c-ab73-e93a7dcf4b08 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.485060 Aug 24 15:39:56.172316 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 11/20] 10.222.0.102 () {60 vars in 1297 bytes} [Wed Aug 24 15:39:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:39:58.577620 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-74a53435-8dd8-420a-ac72-9e7b3da9826a admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:58.578970 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-74a53435-8dd8-420a-ac72-9e7b3da9826a admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001947 Aug 24 15:39:58.579814 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 10/21] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:39:58 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:59.027088 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-4e5153bb-720a-4995-b31b-4942b656d500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:59.064941 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-4e5153bb-720a-4995-b31b-4942b656d500 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477993 Aug 24 15:39:59.066271 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 12/22] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:39:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:39:59.078576 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-2908cb30-261f-4ba3-97f5-f9cba4bf631d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:59.105268 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-2908cb30-261f-4ba3-97f5-f9cba4bf631d admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030303 Aug 24 15:39:59.105726 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 11/23] 10.222.0.102 () {64 vars in 1338 bytes} [Wed Aug 24 15:39:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:02.010724 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-4e5153bb-720a-4995-b31b-4942b656d500 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:02.011777 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-4e5153bb-720a-4995-b31b-4942b656d500 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001467 Aug 24 15:40:02.012190 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 13/24] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:40:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:02.409155 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-b585e6e5-20fe-4e90-8a00-424f30860792 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "vcpus": 1, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:02.429294 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-b585e6e5-20fe-4e90-8a00-424f30860792 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.411143 Aug 24 15:40:02.430142 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 12/25] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:40:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:02.442087 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-f20fe553-d40b-48bb-8852-d16cc2b854f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:02.467146 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-f20fe553-d40b-48bb-8852-d16cc2b854f4 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028681 Aug 24 15:40:02.467743 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 14/26] 10.222.0.102 () {64 vars in 1338 bytes} [Wed Aug 24 15:40:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:04.857848 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-b585e6e5-20fe-4e90-8a00-424f30860792 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:04.859440 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-b585e6e5-20fe-4e90-8a00-424f30860792 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002016 Aug 24 15:40:04.863973 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 13/27] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:40:04 2022] GET /compute/v2.1 => generated 389 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:05.426355 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-47ae817b-02fb-4681-be59-4c67ea4cda49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:05.451122 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-47ae817b-02fb-4681-be59-4c67ea4cda49 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.585120 Aug 24 15:40:05.452124 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 15/28] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:40:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:05.465626 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-63fd1c58-a760-4586-96bd-e78f4f91b704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:05.493154 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-63fd1c58-a760-4586-96bd-e78f4f91b704 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030978 Aug 24 15:40:05.493965 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 14/29] 10.222.0.102 () {64 vars in 1338 bytes} [Wed Aug 24 15:40:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:07.955699 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-47ae817b-02fb-4681-be59-4c67ea4cda49 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:07.956728 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-47ae817b-02fb-4681-be59-4c67ea4cda49 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001550 Aug 24 15:40:07.957131 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 16/30] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:40:07 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:08.422662 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-1131428d-5847-4c1a-a839-701bd311360c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:08.429142 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:08.448755 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-1131428d-5847-4c1a-a839-701bd311360c admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483232 Aug 24 15:40:08.448755 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 15/31] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:40:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:08.459455 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-10d9ff18-4a1c-4ac3-bb90-ba9c1bb7cbf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:08.485135 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-10d9ff18-4a1c-4ac3-bb90-ba9c1bb7cbf3 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029406 Aug 24 15:40:08.486035 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 17/32] 10.222.0.102 () {64 vars in 1338 bytes} [Wed Aug 24 15:40:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:10.953123 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-1131428d-5847-4c1a-a839-701bd311360c admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:10.954743 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-1131428d-5847-4c1a-a839-701bd311360c admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002058 Aug 24 15:40:10.955297 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 16/33] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:40:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:40:11.410495 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-bb719d54-c71d-480a-99b7-1141e4cc91af admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:11.431979 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-bb719d54-c71d-480a-99b7-1141e4cc91af admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.470442 Aug 24 15:40:11.433079 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 18/34] 10.222.0.102 () {64 vars in 1288 bytes} [Wed Aug 24 15:40:10 2022] POST /compute/v2.1/flavors => generated 410 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:11.446074 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-8137e428-a3b7-4fbe-8856-6f37e1a5ba3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:11.472039 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-8137e428-a3b7-4fbe-8856-6f37e1a5ba3d admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030733 Aug 24 15:40:11.488196 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 17/35] 10.222.0.102 () {64 vars in 1338 bytes} [Wed Aug 24 15:40:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:30.072162 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-bb719d54-c71d-480a-99b7-1141e4cc91af admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:30.073169 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-bb719d54-c71d-480a-99b7-1141e4cc91af admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001512 Aug 24 15:40:30.073567 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 19/36] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:40:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:30.084245 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:30.592261 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-0fdf2e6e-e84a-4b00-9b61-7da01cbebfcb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:30.611155 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-0fdf2e6e-e84a-4b00-9b61-7da01cbebfcb admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.531244 Aug 24 15:40:30.611675 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 18/37] 10.222.0.102 () {60 vars in 1297 bytes} [Wed Aug 24 15:40:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:40:31.695976 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-bb719d54-c71d-480a-99b7-1141e4cc91af admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:31.697015 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-bb719d54-c71d-480a-99b7-1141e4cc91af admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001494 Aug 24 15:40:31.697436 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 20/38] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:31 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:32.246229 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e90d3d90-8673-4639-baeb-c1b0ae732153 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:32.251856 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.wsgi [None req-e90d3d90-8673-4639-baeb-c1b0ae732153 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e90d3d90-8673-4639-baeb-c1b0ae732153 admin admin] Request method failure captured: Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Accept: application/json Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Accept-Encoding: gzip, deflate Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Connection: keep-alive Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Content-Length: 0 Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Host: 10.222.0.102 Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Openstack-Api-Version: compute 2.90 Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Openstack-System-Scope: None Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: User-Agent: python-novaclient Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Auth-Token: gAAAAABjBkZvjXRs53WG2jFC95UaqZpObyUkYXqri-qIvDlVGAD99TUskakXt8RzYIWBkqBk2f3MJ71uYiKP3d8Lt66clEEadYM57PyD0XLwdrZGN-Rs5m61yM-hoc_mbU-e6pYHzQFzMXdv9GW2jgjR4kFgOt1PzZSDillP8spfLyA5c3L_QsE Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Domain-Id: None Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Domain-Name: None Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Identity-Status: Confirmed Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Is-Admin-Project: True Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Domain-Id: default Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Domain-Name: Default Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Name: admin Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Role: admin,member,reader Aug 24 15:40:32.255002 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Roles: admin,member,reader Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/501a315437844349bdc02dafe337b855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_501a315437844349bdc02dafe337b855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant: admin Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant-Name: admin Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User: admin Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Domain-Id: default Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Domain-Name: Default Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Id: 3eb7904f17244b85baf19c438c53917f Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Name: admin Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: method: > Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: exception: Flavor 42 could not be found. Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: action_args: {'id': '42'} Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:32.257192 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:32.258100 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.259226 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e90d3d90-8673-4639-baeb-c1b0ae732153 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:32.260318 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-e90d3d90-8673-4639-baeb-c1b0ae732153 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.415791 Aug 24 15:40:32.260318 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 19/39] 10.222.0.102 () {60 vars in 1195 bytes} [Wed Aug 24 15:40:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:32.266312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-cbc359a1-058b-4e30-a6dd-5a4a53139464 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:32.270589 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:32.291299 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-cbc359a1-058b-4e30-a6dd-5a4a53139464 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028543 Aug 24 15:40:32.291890 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 21/40] 10.222.0.102 () {60 vars in 1215 bytes} [Wed Aug 24 15:40:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:40:32.301969 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-bd4851f0-a296-4311-8922-628974cb8182 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:32.325838 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-bd4851f0-a296-4311-8922-628974cb8182 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027721 Aug 24 15:40:32.326373 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 20/41] 10.222.0.102 () {60 vars in 1215 bytes} [Wed Aug 24 15:40:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:40:32.336417 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-6e62764f-6da1-4747-a1ce-6cb1fd2abacf admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:32.342724 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.wsgi [None req-6e62764f-6da1-4747-a1ce-6cb1fd2abacf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-6e62764f-6da1-4747-a1ce-6cb1fd2abacf admin admin] Request method failure captured: Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Accept: application/json Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Accept-Encoding: gzip, deflate Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Connection: keep-alive Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Content-Length: 0 Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Host: 10.222.0.102 Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Openstack-Api-Version: compute 2.90 Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Openstack-System-Scope: None Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: User-Agent: python-novaclient Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Auth-Token: gAAAAABjBkZvjXRs53WG2jFC95UaqZpObyUkYXqri-qIvDlVGAD99TUskakXt8RzYIWBkqBk2f3MJ71uYiKP3d8Lt66clEEadYM57PyD0XLwdrZGN-Rs5m61yM-hoc_mbU-e6pYHzQFzMXdv9GW2jgjR4kFgOt1PzZSDillP8spfLyA5c3L_QsE Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Domain-Id: None Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Domain-Name: None Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Identity-Status: Confirmed Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Is-Admin-Project: True Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Domain-Id: default Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Domain-Name: Default Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Name: admin Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Role: admin,member,reader Aug 24 15:40:32.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Roles: admin,member,reader Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/501a315437844349bdc02dafe337b855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_501a315437844349bdc02dafe337b855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant: admin Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant-Name: admin Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User: admin Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Domain-Id: default Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Domain-Name: Default Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Id: 3eb7904f17244b85baf19c438c53917f Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Name: admin Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: method: > Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: exception: Flavor 42 could not be found. Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: action_args: {'id': '42'} Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:32.347465 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:32.348461 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:32.350402 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-6e62764f-6da1-4747-a1ce-6cb1fd2abacf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:32.351615 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-6e62764f-6da1-4747-a1ce-6cb1fd2abacf admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015187 Aug 24 15:40:32.351615 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 22/42] 10.222.0.102 () {60 vars in 1195 bytes} [Wed Aug 24 15:40:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:33.320619 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-bd4851f0-a296-4311-8922-628974cb8182 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:33.321631 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-bd4851f0-a296-4311-8922-628974cb8182 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Aug 24 15:40:33.322031 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 21/43] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:33 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:33.847768 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-d1909094-e3a9-495b-ad0f-8771f80a3413 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:33.854016 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.wsgi [None req-d1909094-e3a9-495b-ad0f-8771f80a3413 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-d1909094-e3a9-495b-ad0f-8771f80a3413 admin admin] Request method failure captured: Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Accept: application/json Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Accept-Encoding: gzip, deflate Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Connection: keep-alive Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Content-Length: 0 Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Host: 10.222.0.102 Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Openstack-Api-Version: compute 2.90 Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Openstack-System-Scope: None Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: User-Agent: python-novaclient Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Auth-Token: gAAAAABjBkZxCSeY9GDleWIDkaH-RHpe0vawiqHhJvc9aT82yxToKfMHQRBArRf8Pf3DOTjD8jOzpZQUGUFAE6EADzTnXM4jn4kn7ILK_3GJGnp2U7UA_tJKqFvqFPrmw2Vy5DBbtzkwz4tqd5z1qbyXsa6E-DjIxBWXoLeTYFavQNjIzXKuWxY Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Domain-Id: None Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Domain-Name: None Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Identity-Status: Confirmed Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Is-Admin-Project: True Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Domain-Id: default Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Domain-Name: Default Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Name: admin Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Role: admin,member,reader Aug 24 15:40:33.855492 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Roles: admin,member,reader Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/501a315437844349bdc02dafe337b855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_501a315437844349bdc02dafe337b855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant: admin Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant-Name: admin Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User: admin Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Domain-Id: default Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Domain-Name: Default Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Id: 3eb7904f17244b85baf19c438c53917f Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Name: admin Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: method: > Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: exception: Flavor 84 could not be found. Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: action_args: {'id': '84'} Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:33.856985 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:33.857827 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.858986 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-d1909094-e3a9-495b-ad0f-8771f80a3413 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:33.860009 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-d1909094-e3a9-495b-ad0f-8771f80a3413 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396893 Aug 24 15:40:33.860009 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 23/44] 10.222.0.102 () {60 vars in 1195 bytes} [Wed Aug 24 15:40:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:33.866730 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-5029bc9d-3b6c-4287-8e4b-47bc1a3e938c admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:33.881785 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-5029bc9d-3b6c-4287-8e4b-47bc1a3e938c admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018754 Aug 24 15:40:33.882329 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 22/45] 10.222.0.102 () {60 vars in 1215 bytes} [Wed Aug 24 15:40:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:40:33.891888 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-0a9ae5f1-e856-46ec-b740-b2c9e8871399 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:33.907481 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-0a9ae5f1-e856-46ec-b740-b2c9e8871399 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019073 Aug 24 15:40:33.908071 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 24/46] 10.222.0.102 () {60 vars in 1215 bytes} [Wed Aug 24 15:40:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:40:33.918229 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-60d5760e-b0b3-4720-9cbd-5582ea60186a admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:33.923596 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.wsgi [None req-60d5760e-b0b3-4720-9cbd-5582ea60186a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-60d5760e-b0b3-4720-9cbd-5582ea60186a admin admin] Request method failure captured: Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Accept: application/json Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Accept-Encoding: gzip, deflate Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Connection: keep-alive Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Content-Length: 0 Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Host: 10.222.0.102 Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Openstack-Api-Version: compute 2.90 Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Openstack-System-Scope: None Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: User-Agent: python-novaclient Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Auth-Token: gAAAAABjBkZxCSeY9GDleWIDkaH-RHpe0vawiqHhJvc9aT82yxToKfMHQRBArRf8Pf3DOTjD8jOzpZQUGUFAE6EADzTnXM4jn4kn7ILK_3GJGnp2U7UA_tJKqFvqFPrmw2Vy5DBbtzkwz4tqd5z1qbyXsa6E-DjIxBWXoLeTYFavQNjIzXKuWxY Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Domain-Id: None Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Domain-Name: None Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Identity-Status: Confirmed Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Is-Admin-Project: True Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Domain-Id: default Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Domain-Name: Default Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Name: admin Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Role: admin,member,reader Aug 24 15:40:33.925136 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Roles: admin,member,reader Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/501a315437844349bdc02dafe337b855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_501a315437844349bdc02dafe337b855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant: admin Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant-Name: admin Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User: admin Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Domain-Id: default Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Domain-Name: Default Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Id: 3eb7904f17244b85baf19c438c53917f Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Name: admin Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: method: > Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: exception: Flavor 84 could not be found. Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: action_args: {'id': '84'} Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:33.926887 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:33.927989 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:33.929459 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-60d5760e-b0b3-4720-9cbd-5582ea60186a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:33.930537 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-60d5760e-b0b3-4720-9cbd-5582ea60186a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011803 Aug 24 15:40:33.930537 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 23/47] 10.222.0.102 () {60 vars in 1195 bytes} [Wed Aug 24 15:40:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:34.932251 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-0a9ae5f1-e856-46ec-b740-b2c9e8871399 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:34.933258 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-0a9ae5f1-e856-46ec-b740-b2c9e8871399 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001479 Aug 24 15:40:34.933664 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 25/48] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:34 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:40:35.467112 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e80bb5b0-c22e-4e10-a881-8d282cd14654 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.472982 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.wsgi [None req-e80bb5b0-c22e-4e10-a881-8d282cd14654 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e80bb5b0-c22e-4e10-a881-8d282cd14654 admin admin] Request method failure captured: Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Accept: application/json Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Accept-Encoding: gzip, deflate Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Connection: keep-alive Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Content-Length: 0 Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Host: 10.222.0.102 Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Openstack-Api-Version: compute 2.90 Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Openstack-System-Scope: None Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: User-Agent: python-novaclient Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Auth-Token: gAAAAABjBkZymg2hTalIi9D6oCcYA4q4KnpPEOaUN3x_-_OaR0FnIQshnxjGMJkmqI4rVmomgm9SUhbKEqSY-ns0qbJ5pwpFhMjrxyrLhL92C-3k4HxTLwkdA08TOOg46QvnNrl4iVOXhQl0vpTghd_wl6Bzj8r4rpid19RX0K_Ze3EFAwls4Ac Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Domain-Id: None Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Domain-Name: None Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Identity-Status: Confirmed Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Is-Admin-Project: True Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Domain-Id: default Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Domain-Name: Default Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Project-Name: admin Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Role: admin,member,reader Aug 24 15:40:35.474503 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Roles: admin,member,reader Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/501a315437844349bdc02dafe337b855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_501a315437844349bdc02dafe337b855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant: admin Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-Tenant-Name: admin Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User: admin Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Domain-Id: default Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Domain-Name: Default Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Id: 3eb7904f17244b85baf19c438c53917f Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: X-User-Name: admin Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: method: > Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: exception: Flavor 451 could not be found. Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: action_args: {'id': '451'} Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:35.476070 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:35.476889 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.478182 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e80bb5b0-c22e-4e10-a881-8d282cd14654 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:35.479404 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-e80bb5b0-c22e-4e10-a881-8d282cd14654 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.401881 Aug 24 15:40:35.479404 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 24/49] 10.222.0.102 () {60 vars in 1198 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:35.485855 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-1052d926-7a77-43be-8430-2425c6af1875 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.501312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-1052d926-7a77-43be-8430-2425c6af1875 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019021 Aug 24 15:40:35.501850 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 26/50] 10.222.0.102 () {60 vars in 1215 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:40:35.512472 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.527469 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018515 Aug 24 15:40:35.528032 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 25/51] 10.222.0.102 () {60 vars in 1215 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:40:35.537822 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-8733c297-77a6-4d00-9d9a-271e123b89f7 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.543850 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.wsgi [None req-8733c297-77a6-4d00-9d9a-271e123b89f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-8733c297-77a6-4d00-9d9a-271e123b89f7 admin admin] Request method failure captured: Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Accept: application/json Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Accept-Encoding: gzip, deflate Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Connection: keep-alive Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Content-Length: 0 Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Host: 10.222.0.102 Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Openstack-Api-Version: compute 2.90 Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Openstack-System-Scope: None Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: User-Agent: python-novaclient Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Auth-Token: gAAAAABjBkZymg2hTalIi9D6oCcYA4q4KnpPEOaUN3x_-_OaR0FnIQshnxjGMJkmqI4rVmomgm9SUhbKEqSY-ns0qbJ5pwpFhMjrxyrLhL92C-3k4HxTLwkdA08TOOg46QvnNrl4iVOXhQl0vpTghd_wl6Bzj8r4rpid19RX0K_Ze3EFAwls4Ac Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Domain-Id: None Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Domain-Name: None Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Identity-Status: Confirmed Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Is-Admin-Project: True Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Domain-Id: default Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Domain-Name: Default Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Project-Name: admin Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Role: admin,member,reader Aug 24 15:40:35.545392 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Roles: admin,member,reader Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/501a315437844349bdc02dafe337b855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_501a315437844349bdc02dafe337b855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/501a315437844349bdc02dafe337b855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant: admin Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant-Id: 501a315437844349bdc02dafe337b855 Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-Tenant-Name: admin Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User: admin Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Domain-Id: default Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Domain-Name: Default Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Id: 3eb7904f17244b85baf19c438c53917f Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: X-User-Name: admin Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: method: > Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: exception: Flavor 451 could not be found. Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: action_args: {'id': '451'} Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:35.546704 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:35.547570 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: ERROR nova.api.openstack.wsgi Aug 24 15:40:35.548930 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-8733c297-77a6-4d00-9d9a-271e123b89f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:35.550178 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-8733c297-77a6-4d00-9d9a-271e123b89f7 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013035 Aug 24 15:40:35.550178 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 27/52] 10.222.0.102 () {60 vars in 1198 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:36.532393 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:36.533446 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001529 Aug 24 15:40:36.533838 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 26/53] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:36 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:37.082280 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-d4a4d4ed-d3f3-43ce-804c-079c8bde8587 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:37.102312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-d4a4d4ed-d3f3-43ce-804c-079c8bde8587 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.424260 Aug 24 15:40:37.102858 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 28/54] 10.222.0.102 () {64 vars in 1240 bytes} [Wed Aug 24 15:40:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:38.133797 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:38.134948 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001603 Aug 24 15:40:38.135350 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 27/55] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:38 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:40:38.680495 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-525852ad-5fe0-442a-af99-5de0699ed5bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:38.701312 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-525852ad-5fe0-442a-af99-5de0699ed5bd admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.424093 Aug 24 15:40:38.701780 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 29/56] 10.222.0.102 () {64 vars in 1240 bytes} [Wed Aug 24 15:40:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:39.704787 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:39.705788 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001429 Aug 24 15:40:39.706177 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 28/57] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:39 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:40:40.245763 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-e1ffe184-ce03-4db7-8f6d-4e86e00fe2c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:40.266164 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-e1ffe184-ce03-4db7-8f6d-4e86e00fe2c2 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.417817 Aug 24 15:40:40.266638 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 30/58] 10.222.0.102 () {64 vars in 1240 bytes} [Wed Aug 24 15:40:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:41.282761 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:41.283812 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001434 Aug 24 15:40:41.284212 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 29/59] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:41 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:41.819134 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-e0f07cb4-d17f-489c-bd34-508e96e505c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:41.839722 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-e0f07cb4-d17f-489c-bd34-508e96e505c0 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.415468 Aug 24 15:40:41.840277 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 31/60] 10.222.0.102 () {64 vars in 1240 bytes} [Wed Aug 24 15:40:41 2022] POST /compute/v2.1/flavors => generated 411 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:40:42.839346 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:42.840398 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 Aug 24 15:40:42.840798 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 30/61] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:40:42 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:43.366171 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-6f8abf56-02c5-405d-abd5-5dab79571c3d admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:43.386948 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-6f8abf56-02c5-405d-abd5-5dab79571c3d admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.404939 Aug 24 15:40:43.387487 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 32/62] 10.222.0.102 () {60 vars in 1207 bytes} [Wed Aug 24 15:40:42 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:41:37.536393 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:37.537457 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-c8923064-84da-4708-a73b-94075c906ddb admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001522 Aug 24 15:41:37.537859 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 31/63] 10.222.0.102 () {54 vars in 936 bytes} [Wed Aug 24 15:41:37 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:37.549335 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:37.942114 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-f7c0507d-c2e4-4f4e-b02b-4529624bc1d2 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:37.963899 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-f7c0507d-c2e4-4f4e-b02b-4529624bc1d2 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.419160 Aug 24 15:41:37.964373 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 33/64] 10.222.0.102 () {60 vars in 1297 bytes} [Wed Aug 24 15:41:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:41:37.986187 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG dbcounter [-] [117487] Writing DB stats nova_api:SELECT=14 {{(pid=117487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:37.989839 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-e55500e0-9960-4b95-a1eb-bd320d29ab5a admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:37.998054 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-e55500e0-9960-4b95-a1eb-bd320d29ab5a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013340 Aug 24 15:41:37.998579 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 32/65] 10.222.0.102 () {60 vars in 1288 bytes} [Wed Aug 24 15:41:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:38.010980 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-10cf75f4-cf5a-4033-a172-bc1e0e77fcfe admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:38.018737 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-10cf75f4-cf5a-4033-a172-bc1e0e77fcfe admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011930 Aug 24 15:41:38.019271 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 34/66] 10.222.0.102 () {60 vars in 1291 bytes} [Wed Aug 24 15:41:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:38.030970 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:38.038472 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011013 Aug 24 15:41:38.038975 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 33/67] 10.222.0.102 () {60 vars in 1291 bytes} [Wed Aug 24 15:41:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:38.051490 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-063c3b81-9aad-4bd9-90c1-0c792798c0ae admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:38.060164 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-063c3b81-9aad-4bd9-90c1-0c792798c0ae admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012352 Aug 24 15:41:38.060685 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 35/68] 10.222.0.102 () {60 vars in 1288 bytes} [Wed Aug 24 15:41:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:43.961065 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:43.962173 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001531 Aug 24 15:44:43.962567 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 34/69] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:44:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:44:44.108551 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_api:SELECT=6 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:44.266515 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:44.269684 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:44.269684 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: warnings.warn(msg) Aug 24 15:44:44.274296 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:44.274779 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:44.275215 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:44.279393 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:44.279884 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:44.280316 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:44.314502 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-cb9096ee-ca23-44be-ae22-ee018af61cbd admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210851 Aug 24 15:44:44.315279 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 36/70] 10.222.0.102 () {60 vars in 1198 bytes} [Wed Aug 24 15:44:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:45.163845 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:45.164847 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001448 Aug 24 15:44:45.165242 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 35/71] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:44:45 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:45.366721 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:45.369116 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:45.369116 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: warnings.warn(msg) Aug 24 15:44:45.370266 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:45.370681 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:45.371140 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:45.371882 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:45.372327 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:45.372752 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:45.393489 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-e1afc92c-130f-47b9-8811-2c81d70461f1 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076448 Aug 24 15:44:45.394084 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 37/72] 10.222.0.102 () {60 vars in 1198 bytes} [Wed Aug 24 15:44:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:56.665959 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:56.666991 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001414 Aug 24 15:44:56.667410 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 36/73] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:44:56 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:56.811617 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_cell0:SELECT=4 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.812361 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_cell1:SELECT=4 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.813258 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG dbcounter [-] [117488] Writing DB stats nova_api:SELECT=8 {{(pid=117488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:56.865953 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:56.868314 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:56.868314 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: warnings.warn(msg) Aug 24 15:44:56.869433 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:56.869901 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:56.870320 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:56.871021 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:56.871459 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:56.871895 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:56.896877 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-3c8e3237-605c-49f1-a7fe-a0af7b416797 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089673 Aug 24 15:44:56.897444 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 38/74] 10.222.0.102 () {60 vars in 1198 bytes} [Wed Aug 24 15:44:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:57.726632 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: DEBUG nova.api.openstack.wsgi [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] Calling method '>' {{(pid=117487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:57.727667 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: INFO nova.api.openstack.requestlog [None req-f544aab3-a49c-4d2f-a9ba-c18b8b352538 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001502 Aug 24 15:44:57.728060 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: [pid: 117487|app: 0|req: 37/75] 10.222.0.102 () {56 vars in 1079 bytes} [Wed Aug 24 15:44:57 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:57.920372 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG nova.api.openstack.wsgi [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Calling method '>' {{(pid=117488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:57.922753 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:57.922753 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: warnings.warn(msg) Aug 24 15:44:57.923837 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:57.924308 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:57.924730 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:57.925437 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:57.925971 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:57.926437 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: DEBUG oslo_concurrency.lockutils [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:57.948332 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: INFO nova.api.openstack.requestlog [None req-dd3934d0-a4c1-48a8-91eb-e7f5f99e3e4b admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080886 Aug 24 15:44:57.948885 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: [pid: 117488|app: 0|req: 39/76] 10.222.0.102 () {60 vars in 1198 bytes} [Wed Aug 24 15:44:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:02.040029 dv-cinder-849325-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 15:46:02.040572 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: Wed Aug 24 15:46:02 2022 - graceful shutdown triggered... Aug 24 15:46:02.040993 dv-cinder-849325-3-iscsi devstack@n-api.service[117487]: Gracefully killing worker 1 (pid: 117487)... Aug 24 15:46:02.041341 dv-cinder-849325-3-iscsi devstack@n-api.service[117488]: Gracefully killing worker 2 (pid: 117488)... Aug 24 15:46:03.041712 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: worker 1 buried after 1 seconds Aug 24 15:46:03.041712 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: worker 2 buried after 1 seconds Aug 24 15:46:03.041712 dv-cinder-849325-3-iscsi devstack@n-api.service[117473]: goodbye to uWSGI. Aug 24 15:46:03.043346 dv-cinder-849325-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 15:46:03.043943 dv-cinder-849325-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 15:46:03.046759 dv-cinder-849325-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 15:46:03.055846 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:46:03 2022] *** Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: nodename: dv-cinder-849325-3-iscsi Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: machine: x86_64 Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: clock source: unix Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: pcre jit disabled Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: detected number of CPU cores: 4 Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: current working directory: / Aug 24 15:46:03.057684 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: your processes number limit is 47680 Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: your memory page size is 4096 bytes Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: detected max file descriptor number: 2048 Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: lock engine: pthread robust mutexes Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: thunder lock: enabled Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 15:46:03.058446 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:46:03.099172 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: Python main interpreter initialized at 0x55fbba2059c0 Aug 24 15:46:03.099172 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: python threads support enabled Aug 24 15:46:03.099172 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: your server socket listen backlog is limited to 100 connections Aug 24 15:46:03.099172 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:46:03.099587 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:46:03.099587 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: *** Operational MODE: preforking *** Aug 24 15:46:03.102959 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:46:03.102959 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: spawned uWSGI master process (pid: 132501) Aug 24 15:46:03.102959 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: spawned uWSGI worker 1 (pid: 132517, cores: 1) Aug 24 15:46:03.102959 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: spawned uWSGI worker 2 (pid: 132518, cores: 1) Aug 24 15:46:03.102959 dv-cinder-849325-3-iscsi devstack@n-api.service[132501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:46:03.099909 dv-cinder-849325-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 15:46:03.787429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:46:03.788072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:46:04.959298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:46:04.959298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: from cryptography.utils import int_from_bytes Aug 24 15:46:04.960015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:46:04.960015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: from cryptography.utils import int_from_bytes Aug 24 15:46:04.967414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:46:04.967414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: from cryptography.utils import int_from_bytes Aug 24 15:46:04.967944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:46:04.967944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: from cryptography.utils import int_from_bytes Aug 24 15:46:07.401099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:46:07.401861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:46:07.401861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:46:07.402243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:46:07.402500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:46:07.402894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.403223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.403548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.403901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.404395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.404811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.405144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.405526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-3-iscsi {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.409865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.410514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.410514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.410514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.410514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.410979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.411299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.411624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.412130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.412479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.412781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.413110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.413426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.413758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.414075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.414489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-3-iscsi {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.414923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.415359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.415740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.416147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.416458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.416772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.417124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.417430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.417741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.418090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.418415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.418740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.419066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.419372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.419727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.420019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.420346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.420485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:46:07.420964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.421100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:46:07.421238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.421238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.421499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:46:07.421651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.421826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:46:07.421992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.422114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:46:07.422251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.422380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.422525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.422675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.422816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.422956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.423990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.424152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.424294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.424464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.424666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.424815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.424953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-3-iscsi {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.425950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.426084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.426271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.426403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.426595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.426729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.426919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.427061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.427230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.427375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.427553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.427719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.427887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.428023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.428219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.428394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.428552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.428697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.428857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.429000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.429176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.429308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.429488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.429644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.429895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.430047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.430200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.430332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.430485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.430626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.430877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.431011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.431212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.431337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.431539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.431761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.431963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-3-iscsi {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.432939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.433130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.433294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.433454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.433609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.433763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.434999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.435209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.435556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.435766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.435928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.435928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.436222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.436368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.436509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.436648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.436787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.436918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.437876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.438986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.439123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.439268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.439398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.439532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.439695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.441586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.441729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.441866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.441997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.442962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.443940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.444080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.444284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.444612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.444747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.444887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.445953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.446631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.446767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.446900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.447961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.448989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.449120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.449263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.449382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.449498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.449626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.449755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.449891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.450043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.450043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.450306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.450444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.450590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.450747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.450892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.451024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.451154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.451283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.451420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.451564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.451722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.451855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.451985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.452127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.452258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.452400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.452532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.452678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.452817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.452957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.453088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.453379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.453524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.453663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.453794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.454027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.454171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.454327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.454530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.454673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.454673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.454930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.455060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.455206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.455337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.455479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.455616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.455823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.455965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.456096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.456235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.456374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.456505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.456635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.456813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.456961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.457101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.457244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.457387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.457526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.457638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.457749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.457885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.458039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.458744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.458888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.459021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.459164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.459304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.459447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.459567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.459715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.459844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.459957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.460097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.460229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.460358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.460498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.460636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.460767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.460905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.461045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.461176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.461313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.461444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.461575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.461737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.461868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.462043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.462693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.462838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.462838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.463146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.463318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.463453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.463584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.463731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.463875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.463998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.464120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.464261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.464399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.464558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.464804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.464950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.465134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.465281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.465552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.465710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.465973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:46:07.466145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.466342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.466609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.466754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.466905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.467049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.467197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.467197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.467578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.467578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.467903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.468071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.468217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.468217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.468483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.468635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.468784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.469038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.469196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.469342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.469519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.469656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.469850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.470015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.470273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.470424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.470568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.470702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.470880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.471897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.472958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.473957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.474097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.474242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.474384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.474515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.474653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.474798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.475894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.476827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.477000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.477149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.477333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.477551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.477795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.478956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.479095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.479234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.479367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.479505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.479748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.479885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.480016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.480328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.480522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.480851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.481995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.482157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.482312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.482466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.482624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.482785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.482931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.483084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.483238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.483384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.483539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.483730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.483904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.484945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.485208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.485360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.485521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.485669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.485820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.485979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.486124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.486276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.486431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.486577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.486768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.486979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.487189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.487412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.487728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.487959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.488996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.489250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.489387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.489528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.489666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.489666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.489921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.490997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.491136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.491355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.491499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.491720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.492067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.492219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.492396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.492522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.492728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.492921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.493256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.493456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.493648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.494972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.495104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.495328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.495463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.495463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.495777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.495921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.496835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.497017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.497321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.497455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.497624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.497745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.498017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.498160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.498343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.498479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.498695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.498836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.499053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.499187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.499491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.499674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.499819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.499951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.500979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.501123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.501258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.501399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.501575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.501717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.501898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.502973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.503133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.503266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.503440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.503575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.503805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.503993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.504127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.504257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.504402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.504538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.504712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.504846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.505977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.506089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.506292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.506420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.506603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.506751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.506892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.507037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.507206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.507340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.507520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.507686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.507874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.508022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.508181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.508313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.509986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.510236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.510373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.510504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.510641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.510854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.510994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.511134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.511265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.511395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.511547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.511739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.511875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.512966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.513144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.513286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.513455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.513588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.513760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.513903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.514982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.515123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.515293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.515566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.515731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.515928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.516078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.516237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.516379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.516526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.516816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.516952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.517909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.518958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.519094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.519286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.519431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.519599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.519754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.519932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.520983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.521149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.521299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.521538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.521682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.521823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.522962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.523108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.523239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.523239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.523482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.523621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.523869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.524015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.524833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.525155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.525323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.525542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.525796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.525963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.526120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.526268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.526414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.526562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.526736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.527048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.527201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.527356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.527503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.527684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.527852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.528771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.529069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.529215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.529368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.529671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.529998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.530396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.530539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.530661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.530775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.530996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.531120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.531426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.531573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.531751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.531889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.532030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.532267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.532412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.532579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.532730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.532890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.533963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.534133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.534275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.534446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.534579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.534718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.534849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.535025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.535160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.535331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.535468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.535687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.535926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.536928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.537214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.537214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.537477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.537608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.537744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.537744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.538948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.539080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.539261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.539396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.539575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.539766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.539935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.540182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.540326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.540532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.540676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.540839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.540972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.541148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.541285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.541460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.541674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.541809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.541947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.542969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.543104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.543273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.543417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.543580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.543807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.543953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.544938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.545110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.545247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.545427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.545562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.545740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.545897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.546938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.547067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.547281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.547426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.547569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.547737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.547907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.548050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.548227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.548370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.548535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.548748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.548871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.549903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.550055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.550176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.550382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.550517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.550772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.555467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.555467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.556940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.557924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.558868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.559154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.560988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.561990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.562888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.563381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.563520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.563716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.563850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.563850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.564096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.564238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.564238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.564503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.564641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.564641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.565923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.566865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.567080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.567264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.567461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.567729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.567871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.568107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.568243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.568422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.568639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.568775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.569038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.569181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.569352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.569560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.569887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.570034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.570257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.570399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.570588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.570836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.571549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.571901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.572222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.572412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.572548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.572843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.572986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.573157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.573344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.573602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.573811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.573955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.574317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.574470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.574615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.574756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.574893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.575137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.575279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.575457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.575797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.575940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.576105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.576288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.576561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.576715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.576849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.577151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.577286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.577465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.577743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.577893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.578068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.578217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.578383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.578792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.578940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.579081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.579212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.579341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.579639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.579951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.580109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.580242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.580372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.580565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.580755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.580995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.581209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.581353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.581603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.581778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.582023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.582338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.582486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.582651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.582978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.583121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.583305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.583478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.583622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.583935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.584069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.584256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.584570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.584724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.584896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.585033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.585226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.585481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.585629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.585844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.585986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.586154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.587536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.587736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.587736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.588876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.589047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.589238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.589372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.589690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.589826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.590125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.590311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.590446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.590627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.590861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.591011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.591232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.591374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.591558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.591772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.592057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.592192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.592497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.592632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.592901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.593164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.593334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.593476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.593617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.593749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.593998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.594145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.594325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.594647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.594805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.594961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.595133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.595277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.595569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.595729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.595936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.596101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.596245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.596543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.596676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.596849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.597020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.597162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.597450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.597585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.597786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.598033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.598174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.598431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.598573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.598768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.598936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.599070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.599382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.599525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.599766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.599914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.600297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.600446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.600576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.600718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.600896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.601045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.601321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.601455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.601634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.601990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.602134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.602284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.602580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.602762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.602900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.603184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.603319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.603491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.603726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.603865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.604139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.604292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.604450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.604682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.604915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.605077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.605222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.605384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.605604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.605747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.605985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.606118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.606331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.606522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.606665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.606957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.607089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.607273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.607417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.607602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.607865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.608013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.608268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.608453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.608601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.608891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.609075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.609216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.609375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.609519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.609817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.609953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.610125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.610494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.610637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.610778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.610918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.611048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.611329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.611620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.611810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.611961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.612269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.612415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.612590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.612909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.613130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.613339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.613479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.613612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.613830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.613972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.614146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.614320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.614455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.614759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.614917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.615132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.615280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.615412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.615702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.615855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.616083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.616228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.616409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.616592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.616728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.617024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.617158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.617340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.617499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.617703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.617981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.618162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.618685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.618859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.619097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.619274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.619596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.619821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.620121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.620272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.620656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.620805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.621082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.621216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.621517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.621662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.621952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.622096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.622428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.622565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.622996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.623132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.623485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.623620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.623959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.624094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.624413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.624549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.624896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.625085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.625331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.625599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.625744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.626076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.626221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.626547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.626688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.626998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.627142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.627438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.627844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.627995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.628321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.628480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.628761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.628895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.629201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.629399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.629886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.630031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.630353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.630488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.630873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.631017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.631327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.631470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.631788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.632057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.632225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.632445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.632664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.632809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.633273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.633408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.634408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.634999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.634999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.636077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.636229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.636367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.636508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.637951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.638375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.638608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.638811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.638971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.639120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.639262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.639396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.639601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.639782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.640050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.640273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.640486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.641041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.641194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.641325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.641471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.641731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.641975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.642162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.642545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.642772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.643115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.643252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.643711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.643867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.644114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.644261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.644551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.644833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.645052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.645410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.645554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.645752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.646075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.646219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.646403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.646586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.646726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.647026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.647174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.647357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.647500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.647701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.647968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.648115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.648336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.648709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.648855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.648998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.649938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.650121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.650482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.650627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.651368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.651530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.651728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.651865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.651865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.652125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.652270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.653162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.653319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.653319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.653903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.654960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.659533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.659533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.659908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.660983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.661556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.661715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.661860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.662003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.662160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.663387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.663541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.663722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.663861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.664986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.665370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.665370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.666041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.666192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.666326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.666326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.666746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.666884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.667997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.668814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.669070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.669202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.669333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.669599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.669862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.670967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.671117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.671281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.671809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.671946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.672875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.673311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.673503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.673647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.673647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.673933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.674066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.674595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.674751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.674903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.675906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.676943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.677215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.677357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.677491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.677622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.677622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.677868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.678944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.679208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.679340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.679478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.679749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.679908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.680282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.680643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.681462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.681844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.681844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.682862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.683123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.683361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.683579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.683771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.684088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.684366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.684512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.684708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.684844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.685025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.685338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.685481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.685651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.685825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.685973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.686452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.686593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.686900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.687130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.687325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.687595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.687774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.688158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.688293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.688595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.688784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.689028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.689264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.689623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.690105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.690363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.690508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.690731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.690874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.691179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.691471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.691607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.692130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.692285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.692757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.693041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.693139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.693260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.693800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.693932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.694305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.694578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.694698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.694911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.695031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.695306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.695419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.695674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.695859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.696524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.696681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.697007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.697241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.697461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.697693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.698004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.698226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.698441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.698645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.698865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.699090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.699309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.699515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.699767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.699767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.700174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.700409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.700615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.700837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.701041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.701266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.701468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.701685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.701898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.702111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.702324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.702528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.702736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.702966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.703189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.703392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.703596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.703853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.704080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.704295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.704511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.704715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.704924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.705139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.705421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.705632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.705862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.705862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.705862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.706456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.706456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.706864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.707077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.707279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.707492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.707792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.708028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.708233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.708469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.708469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.708864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.709089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.709304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.709516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.709731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.709935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.710149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.710370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.710572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.710805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.710992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.711159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.711309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.711468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.711753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.712702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.713876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.713876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.713876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.713876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.713876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.713876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.714700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.714700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.714700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.715102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.715245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.715655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.716004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.716319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.716633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.716945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.717258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.717571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.717882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.718366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.718536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.718833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.719160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.719479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.719824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.720143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.720457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.720790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.721102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.721411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.721719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.722032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.722372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.722691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.723002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.723315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.723670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.723975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.724306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.724641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.724956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.725328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.725752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.726110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.726426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.726773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.727102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.727480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.727997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.728392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:46:07.728639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:46:07.773175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO dbcounter [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Registered counter for database nova_api Aug 24 15:46:07.790858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO dbcounter [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Registered counter for database nova_api Aug 24 15:46:07.794734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_db.sqlalchemy.engines [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:07.802392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writer thread running {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:07.811713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_db.sqlalchemy.engines [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:07.818475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writer thread running {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:07.866223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.context [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4c1394e-0d00-43a6-95ee-abb5457791d3(cell1) {{(pid=132517) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:46:07.871515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:07.872036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:07.874137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:07.874909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:07.875468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:07.877715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:07.879849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.context [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a4c1394e-0d00-43a6-95ee-abb5457791d3(cell1) {{(pid=132518) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:46:07.880026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO dbcounter [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Registered counter for database nova_cell0 Aug 24 15:46:07.884827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:07.884980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO dbcounter [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Registered counter for database nova_cell1 Aug 24 15:46:07.885139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:07.886834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:07.887467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:07.887992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:07.889948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:07.892656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_db.sqlalchemy.engines [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:07.892823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO dbcounter [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Registered counter for database nova_cell0 Aug 24 15:46:07.893184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_db.sqlalchemy.engines [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:07.896195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO dbcounter [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Registered counter for database nova_cell1 Aug 24 15:46:07.899282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writer thread running {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:07.904210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_db.sqlalchemy.engines [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:07.907531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_db.sqlalchemy.engines [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:07.914711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writer thread running {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:07.916112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writer thread running {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:08.047227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writer thread running {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:08.057377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO dbcounter [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Registered counter for database nova_cell0 Aug 24 15:46:08.064524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_db.sqlalchemy.engines [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:08.069373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO dbcounter [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Registered counter for database nova_cell0 Aug 24 15:46:08.070267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writer thread running {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:08.079460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_db.sqlalchemy.engines [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:46:08.085254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writer thread running {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:46:08.398928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: WARNING keystonemiddleware.auth_token [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:46:08.406256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: WARNING keystonemiddleware.auth_token [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:46:08.409342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: WARNING keystonemiddleware.auth_token [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:46:08.417156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: WARNING keystonemiddleware.auth_token [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:46:08.752165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: WARNING keystonemiddleware.auth_token [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:46:08.757874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: WARNING keystonemiddleware.auth_token [None req-7508e3aa-9802-4e5a-a748-e27375db47ec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:46:08.763998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: WARNING keystonemiddleware.auth_token [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:46:08.764151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fbba2059c0 pid: 132517 (default app) Aug 24 15:46:08.769951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: WARNING keystonemiddleware.auth_token [None req-6d07077a-c4b9-4b85-a6a5-aa1c60bbf041 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:46:08.775297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fbba2059c0 pid: 132518 (default app) Aug 24 15:46:45.454041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.456102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.457135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.458518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.891662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.908098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.910695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.915889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:47.662925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c903580a-64b5-4721-bcb4-f2466b98160f tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Action: 'create', calling method: .version_select at 0x7fc5ce9d68b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-85025866", "metadata": {"Type": "work"}}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:47.857445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4a0c6736-ee25-4cc1-ae29-62c8f9e1f098 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Action: 'create', calling method: .version_select at 0x7fc5ce9d0940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1617931234"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:49.857760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4a0c6736-ee25-4cc1-ae29-62c8f9e1f098 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.975632 Aug 24 15:46:49.869275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1/1] 10.222.0.102 () {60 vars in 1160 bytes} [Wed Aug 24 15:46:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3988 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 24 15:46:49.869670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c903580a-64b5-4721-bcb4-f2466b98160f tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 4.434212 Aug 24 15:46:49.870398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1/2] 10.222.0.102 () {60 vars in 1161 bytes} [Wed Aug 24 15:46:45 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 4437 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Aug 24 15:46:49.886072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2b7e97e5-0746-46e5-9c04-bdf6c660f814 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce82c790>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:49.892753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0e5c8e5-7637-4a2a-b872-95238d750659 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce82a700>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:50.048533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0e5c8e5-7637-4a2a-b872-95238d750659 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 200 len: 351 microversion: 2.1 time: 0.161663 Aug 24 15:46:50.049100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2/3] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:49 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:50.052079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2b7e97e5-0746-46e5-9c04-bdf6c660f814 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 200 len: 345 microversion: 2.1 time: 0.180967 Aug 24 15:46:50.058789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 2/4] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:49 2022] GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:46:51.062466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-443396c0-6ad9-4ed7-95f3-e36a612c7406 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce82adc0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:51.069499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9b36e4b-aa18-4027-b603-aeb8421ae74f tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce82ce50>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:51.203561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-443396c0-6ad9-4ed7-95f3-e36a612c7406 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 200 len: 352 microversion: 2.1 time: 0.144854 Aug 24 15:46:51.204635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 3/5] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:51 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:51.215347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9b36e4b-aa18-4027-b603-aeb8421ae74f tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 200 len: 346 microversion: 2.1 time: 0.152697 Aug 24 15:46:51.217100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-68c8d9c5-1719-4f84-9b2e-eadc4841ab0a tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce8414c0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:51.224107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 3/6] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:51 2022] GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:51.232380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e048c1bc-58dd-4d4e-9d3d-89418bf34918 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Action: 'create', calling method: .version_select at 0x7fc5ce8404c0>, body: {"snapshot": {"volume_id": "7f1bd51d-5409-4802-b156-53fdf1814c39", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-718915121"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:51.430167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-68c8d9c5-1719-4f84-9b2e-eadc4841ab0a tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 200 len: 352 microversion: 2.1 time: 0.216710 Aug 24 15:46:51.431129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 4/7] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:51 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 352 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:51.449401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98ce5211-e9b0-4db5-a9e6-968a13a84a57 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce82aaf0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:51.693572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e048c1bc-58dd-4d4e-9d3d-89418bf34918 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.467975 Aug 24 15:46:51.702100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 4/8] 10.222.0.102 () {60 vars in 1167 bytes} [Wed Aug 24 15:46:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:51.715966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4b338b2e-e8a5-4cf9-9422-1ddd01971b87 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce840dc0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:51.903094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98ce5211-e9b0-4db5-a9e6-968a13a84a57 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 202 len: 0 microversion: 2.1 time: 0.457767 Aug 24 15:46:51.904031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 5/9] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:46:51 2022] DELETE /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:46:51.912168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-76f07bca-ae95-40ee-926b-5f8c83d9c855 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce82a4c0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:52.087414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4b338b2e-e8a5-4cf9-9422-1ddd01971b87 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 200 len: 286 microversion: 2.1 time: 0.383531 Aug 24 15:46:52.096669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 5/10] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:51 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:52.103062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a1b6f49a-28e2-4f97-8572-53fb81ccd6c2 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce840430>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:52.204453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-76f07bca-ae95-40ee-926b-5f8c83d9c855 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 200 len: 351 microversion: 2.1 time: 0.295924 Aug 24 15:46:52.205623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 6/11] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:51 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 351 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:46:52.277992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a1b6f49a-28e2-4f97-8572-53fb81ccd6c2 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.180011 Aug 24 15:46:52.285134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 6/12] 10.222.0.102 () {58 vars in 1145 bytes} [Wed Aug 24 15:46:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:52.291402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-405fd399-2a80-4703-9534-2e878b4fa413 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce8413a0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:52.388447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-405fd399-2a80-4703-9534-2e878b4fa413 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 200 len: 286 microversion: 2.1 time: 0.101526 Aug 24 15:46:52.389780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 7/13] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:52 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:46:53.223146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc68a050-8787-4b54-b2cc-1698a7d4e520 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce84b0d0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:53.320836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc68a050-8787-4b54-b2cc-1698a7d4e520 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 200 len: 351 microversion: 2.1 time: 0.105887 Aug 24 15:46:53.321602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 7/14] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:53 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:53.406775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0196b032-0dc7-4113-8f4f-1ce293734714 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce82a5e0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:53.465460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0196b032-0dc7-4113-8f4f-1ce293734714 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 200 len: 286 microversion: 2.1 time: 0.066775 Aug 24 15:46:53.466037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 8/15] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:53 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:54.334714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-710ccd2c-9b80-43fa-940e-1d6628655325 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce82c700>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:54.434398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-710ccd2c-9b80-43fa-940e-1d6628655325 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 200 len: 351 microversion: 2.1 time: 0.103659 Aug 24 15:46:54.435128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 8/16] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:54 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:54.478645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b04d29bf-dc07-4da0-b6f6-7c0f15028fc4 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce82ad30>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:54.516938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b04d29bf-dc07-4da0-b6f6-7c0f15028fc4 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 200 len: 286 microversion: 2.1 time: 0.042664 Aug 24 15:46:54.521978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 9/17] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:54 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:55.450333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-642000fd-ddc9-4152-b7ba-97c42ffa3a83 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Calling method '.version_select at 0x7fc5ce82cdc0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:55.534108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c34c04fb-9fe3-4dda-bd24-2c193a4f336e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce8411f0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:55.589487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-642000fd-ddc9-4152-b7ba-97c42ffa3a83 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] HTTP exception thrown: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-642000fd-ddc9-4152-b7ba-97c42ffa3a83 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Request method failure captured: Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 HTTP/1.1 Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkflS_qDRVUNU-kdDROfLyAtdoYGbEpevmlZtYiS8oCmKk4HvWU2bl5GGu5XQ0jkmBOyUhYNVCR2lF5Y3bJ-Y0tJlFLLdg2mcKZ5j_p94T4pKJ_D1WHqWP87TuiFD9v020y6T5tXtHZY01UHG_akEKxVp0_lw1rs4PF7PkYtrEotX0I Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: e64b544bd42945e8bc11abeb9cf4cf0a Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesGetTestJSON-185039521 Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:46:55.593849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/e64b544bd42945e8bc11abeb9cf4cf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/e64b544bd42945e8bc11abeb9cf4cf0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_e64b544bd42945e8bc11abeb9cf4cf0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/e64b544bd42945e8bc11abeb9cf4cf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesGetTestJSON-185039521 Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: e64b544bd42945e8bc11abeb9cf4cf0a Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesGetTestJSON-185039521 Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesGetTestJSON-185039521-project Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 2f3ce0702d194ad9a78aed3a4fefe205 Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesGetTestJSON-185039521-project Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0'} Aug 24 15:46:55.594905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. (HTTP 404) (Request-ID: req-43e3e84c-3a11-4f72-891e-8743671beb59) Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:55.595556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:55.596495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:46:55.597369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. Aug 24 15:46:55.598356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:55.600734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-642000fd-ddc9-4152-b7ba-97c42ffa3a83 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] Returning 404 to user: Volume bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:46:55.601899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-642000fd-ddc9-4152-b7ba-97c42ffa3a83 tempest-VolumesGetTestJSON-185039521 tempest-VolumesGetTestJSON-185039521-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0" status: 404 len: 109 microversion: 2.1 time: 0.157578 Aug 24 15:46:55.602550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 9/18] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:55 2022] GET /compute/v2.1/os-volumes/bc5e21fb-b2f7-43b2-847f-cd21eb6cfde0 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:46:55.632202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c34c04fb-9fe3-4dda-bd24-2c193a4f336e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 200 len: 287 microversion: 2.1 time: 0.103851 Aug 24 15:46:55.634855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 10/19] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:55 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:46:55.646190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-054c2124-73dd-44b5-8af8-2671dd2de9b6 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce84b430>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:55.803353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-054c2124-73dd-44b5-8af8-2671dd2de9b6 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "DELETE /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 202 len: 0 microversion: 2.1 time: 0.161061 Aug 24 15:46:55.804020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 10/20] 10.222.0.102 () {58 vars in 1259 bytes} [Wed Aug 24 15:46:55 2022] DELETE /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:46:55.817851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e87f667-dc25-4861-9c58-898365d6f8e8 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce82ae50>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:55.894198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e87f667-dc25-4861-9c58-898365d6f8e8 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 200 len: 286 microversion: 2.1 time: 0.084406 Aug 24 15:46:55.895867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 11/21] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:55 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:56.908552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91ad1921-623b-4a0f-8ebe-097df18d58ae tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce84b700>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:56.967147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-91ad1921-623b-4a0f-8ebe-097df18d58ae tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] HTTP exception thrown: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91ad1921-623b-4a0f-8ebe-097df18d58ae tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Request method failure captured: Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 HTTP/1.1 Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkflSRuy9H4DBYNAU4ydbQezfaF01RCutivJhMLAYDm7hOgRBZaB3prW_y-VX_j9-v9JzkinDj7jK1Ev_nlvstdyHApJptAEAu_6gUftvumkqebrkh0KoK4-GKuSmOPYoJUOak-3wTaYZCXQ_H2QEl7O1yJHifzPPcN1lE_gaoNa6uU Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:46:56.974478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: b7052b97e46e449685a65537f3b11864 Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '53d34d18-fa92-43e4-9627-b1db54bc3492'} Aug 24 15:46:56.975911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. (HTTP 404) (Request-ID: req-874c8db1-a68a-40b1-9b29-d60bf224b3c5) Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.976643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:56.978098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 15:46:56.979101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. Aug 24 15:46:56.980581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:56.984293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91ad1921-623b-4a0f-8ebe-097df18d58ae tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Returning 404 to user: Snapshot 53d34d18-fa92-43e4-9627-b1db54bc3492 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:46:56.985503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91ad1921-623b-4a0f-8ebe-097df18d58ae tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492" status: 404 len: 111 microversion: 2.1 time: 0.082635 Aug 24 15:46:56.986642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 11/22] 10.222.0.102 () {58 vars in 1256 bytes} [Wed Aug 24 15:46:56 2022] GET /compute/v2.1/os-snapshots/53d34d18-fa92-43e4-9627-b1db54bc3492 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:46:56.996812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1899057e-cbb1-4f02-8f03-76b6a0b33a0d tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce82a670>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:57.200671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1899057e-cbb1-4f02-8f03-76b6a0b33a0d tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 202 len: 0 microversion: 2.1 time: 0.205765 Aug 24 15:46:57.203783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 12/23] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:46:56 2022] DELETE /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:46:57.213903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9b831424-1ef0-4916-96f9-13377386d916 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce84b4c0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:57.326860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9b831424-1ef0-4916-96f9-13377386d916 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 200 len: 345 microversion: 2.1 time: 0.119533 Aug 24 15:46:57.327590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 12/24] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:57 2022] GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:57.848565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-934248466", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:58.175704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] validate_networks() for [('c9c3de11-538a-4e00-8d30-916ea1bdc94f', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:46:58.345979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-729c623b-5c3f-49b7-8feb-e4b0bd182ea1 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce84bf70>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:58.426054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-729c623b-5c3f-49b7-8feb-e4b0bd182ea1 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] HTTP exception thrown: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-729c623b-5c3f-49b7-8feb-e4b0bd182ea1 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Request method failure captured: Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 HTTP/1.1 Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkflSRuy9H4DBYNAU4ydbQezfaF01RCutivJhMLAYDm7hOgRBZaB3prW_y-VX_j9-v9JzkinDj7jK1Ev_nlvstdyHApJptAEAu_6gUftvumkqebrkh0KoK4-GKuSmOPYoJUOak-3wTaYZCXQ_H2QEl7O1yJHifzPPcN1lE_gaoNa6uU Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:46:58.428242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: b7052b97e46e449685a65537f3b11864 Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '7f1bd51d-5409-4802-b156-53fdf1814c39'} Aug 24 15:46:58.429389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. (HTTP 404) (Request-ID: req-38b37378-c066-41a4-be38-e224e173627b) Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:58.431360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:46:58.432293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.433180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.434944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-729c623b-5c3f-49b7-8feb-e4b0bd182ea1 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Returning 404 to user: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:46:58.436225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-729c623b-5c3f-49b7-8feb-e4b0bd182ea1 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 404 len: 109 microversion: 2.1 time: 0.098182 Aug 24 15:46:58.440878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 13/25] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:58 2022] GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:46:58.454985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4b453a1-e038-419d-b322-0b213aff6696 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce84be50>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:58.536577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-e4b453a1-e038-419d-b322-0b213aff6696 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] HTTP exception thrown: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4b453a1-e038-419d-b322-0b213aff6696 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Request method failure captured: Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 HTTP/1.1 Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkflSRuy9H4DBYNAU4ydbQezfaF01RCutivJhMLAYDm7hOgRBZaB3prW_y-VX_j9-v9JzkinDj7jK1Ev_nlvstdyHApJptAEAu_6gUftvumkqebrkh0KoK4-GKuSmOPYoJUOak-3wTaYZCXQ_H2QEl7O1yJHifzPPcN1lE_gaoNa6uU Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:46:58.539026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: b7052b97e46e449685a65537f3b11864 Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '7f1bd51d-5409-4802-b156-53fdf1814c39'} Aug 24 15:46:58.540674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. (HTTP 404) (Request-ID: req-03f03f6f-5850-4378-b784-f3b7f11df4e4) Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.541290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:46:58.542183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:46:58.543070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.548148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.554141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4b453a1-e038-419d-b322-0b213aff6696 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Returning 404 to user: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:46:58.556308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e4b453a1-e038-419d-b322-0b213aff6696 tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 404 len: 109 microversion: 2.1 time: 0.113074 Aug 24 15:46:58.560479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 14/26] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:46:58 2022] DELETE /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:46:58.568317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c55b7ed7-01d7-415d-8f06-08b98fc0730e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Calling method '.version_select at 0x7fc5ce7ca160>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:58.635498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-c55b7ed7-01d7-415d-8f06-08b98fc0730e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] HTTP exception thrown: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c55b7ed7-01d7-415d-8f06-08b98fc0730e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Request method failure captured: Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 HTTP/1.1 Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkflSRuy9H4DBYNAU4ydbQezfaF01RCutivJhMLAYDm7hOgRBZaB3prW_y-VX_j9-v9JzkinDj7jK1Ev_nlvstdyHApJptAEAu_6gUftvumkqebrkh0KoK4-GKuSmOPYoJUOak-3wTaYZCXQ_H2QEl7O1yJHifzPPcN1lE_gaoNa6uU Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:46:58.637651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/42da093227fd487c8df40a14d4a38c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 42da093227fd487c8df40a14d4a38c1a Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-840559072 Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: b7052b97e46e449685a65537f3b11864 Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesSnapshotsTestJSON-840559072-project Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '7f1bd51d-5409-4802-b156-53fdf1814c39'} Aug 24 15:46:58.638849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. (HTTP 404) (Request-ID: req-1df47535-6372-424a-9491-8ad59a35c41c) Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.639533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:46:58.640596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:46:58.641610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. Aug 24 15:46:58.642668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:46:58.643857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c55b7ed7-01d7-415d-8f06-08b98fc0730e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] Returning 404 to user: Volume 7f1bd51d-5409-4802-b156-53fdf1814c39 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:46:58.644603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c55b7ed7-01d7-415d-8f06-08b98fc0730e tempest-VolumesSnapshotsTestJSON-840559072 tempest-VolumesSnapshotsTestJSON-840559072-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39" status: 404 len: 109 microversion: 2.1 time: 0.083033 Aug 24 15:46:58.645250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 15/27] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:46:58 2022] GET /compute/v2.1/os-volumes/7f1bd51d-5409-4802-b156-53fdf1814c39 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:02.340520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1145780991", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "networks": [{"uuid": "fc1b2c5d-aed2-4a10-aa37-322f0eec21e1"}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:02.520526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] validate_networks() for [('fc1b2c5d-aed2-4a10-aa37-322f0eec21e1', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:47:03.148355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:03.149607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:03.149758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:03.150996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:03.151958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:03.175950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:03.177246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:03.178556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:03.180348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:03.181175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:03.181919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:03.225252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:03.234362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for user 2fe5724620da46ddbefbdfd442dc8d73 and project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:03.251917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:03.257452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:03.413941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63b090a9-97d2-4f35-aa81-aaaf327401f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 6.111219 Aug 24 15:47:03.421639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 13/28] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:46:57 2022] POST /compute/v2.1/servers => generated 385 bytes in 6120 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:47:03.911083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6ec4bf9a-03e9-4be1-a6fc-6f5b1cd18954 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'create', calling method: .version_select at 0x7fc5cdedc280>, body: {"keypair": {"name": "tempest-keypair-379967176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtdoLmAGm5yYUKEfgrR7GpHRYL/LTbAFQuoMCLEFUWyrnyLAXOMiUKryJPl53bqkj446b3XQgjqIBWllNEvehoYrBbytcFEbIoWO0mw21htXXuGvHzogAu0pJ9GkG/SlQ=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:03.971011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-6ec4bf9a-03e9-4be1-a6fc-6f5b1cd18954 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:03.998163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-6ec4bf9a-03e9-4be1-a6fc-6f5b1cd18954 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for user c058b07c1e9e443ebacbf38b1f13e58b and project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:04.122915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6ec4bf9a-03e9-4be1-a6fc-6f5b1cd18954 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.699841 Aug 24 15:47:04.133572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 14/29] 10.222.0.102 () {62 vars in 1205 bytes} [Wed Aug 24 15:47:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 711 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 15:47:04.887754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b1860496-d0db-474c-974c-610261c75be5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'create', calling method: .version_select at 0x7fc5cdee4670>, body: {"keypair": {"name": "tempest-keypair-1695529222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeyXzirGaubVC6Z+xE2o50d6GrftvYdIZYaZGAHPaTH/CrKUecvUCU3uHm0EGqMBgR/YZVTRIqeut3UGXtylLM/j336CgQ+ZwNV6l/tBNHuz9Pnip2Z20YD6K8NPFbRmw=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:04.938743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-b1860496-d0db-474c-974c-610261c75be5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:04.958245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-b1860496-d0db-474c-974c-610261c75be5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for user 38f7d31cf0f541f58af7d3d850af6472 and project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:05.013629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b1860496-d0db-474c-974c-610261c75be5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.878032 Aug 24 15:47:05.021234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 15/30] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 15:47:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:05.027348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d9a8e683-6f54-4c31-9739-d1fc5d8a8c2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:05.028041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d9a8e683-6f54-4c31-9739-d1fc5d8a8c2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:05.082106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:05.083519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:05.084457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:05.085167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:05.086531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:05.152348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:05.153055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:05.155582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:05.159038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:05.160697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:05.162079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:05.278402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Getting quotas for project b454a2613ce5453b81b0a78019eed614. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:05.294402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Getting quotas for user 9db03e18a7b24157a8ac724a615373f4 and project b454a2613ce5453b81b0a78019eed614. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:05.333789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:05.337110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:05.372700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d9a8e683-6f54-4c31-9739-d1fc5d8a8c2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:05.404846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d9a8e683-6f54-4c31-9739-d1fc5d8a8c2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1225 microversion: 2.1 time: 0.389069 Aug 24 15:47:05.405921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 16/31] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:05 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1225 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:05.532947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-68b2b55b-c054-429f-837f-bdc7eed8ea11 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.079998 Aug 24 15:47:05.533765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 16/32] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:47:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 4081 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:47:05.547360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4e6b95e-ee05-4792-b097-07b8d915aa6f tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:05.548220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b4e6b95e-ee05-4792-b097-07b8d915aa6f tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:05.855237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b4e6b95e-ee05-4792-b097-07b8d915aa6f tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:05.868572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b4e6b95e-ee05-4792-b097-07b8d915aa6f tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1219 microversion: 2.1 time: 0.319327 Aug 24 15:47:05.874772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 17/33] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:05 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1219 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:06.410153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1556679302", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:06.661123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] validate_networks() for [('c9c3de11-538a-4e00-8d30-916ea1bdc94f', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:47:06.909350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4dec830a-66bc-4946-8e6a-19eabf4c73bf tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:06.916395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4dec830a-66bc-4946-8e6a-19eabf4c73bf tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:07.624228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4dec830a-66bc-4946-8e6a-19eabf4c73bf tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:07.669068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4dec830a-66bc-4946-8e6a-19eabf4c73bf tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1219 microversion: 2.1 time: 0.763407 Aug 24 15:47:07.690330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 18/34] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:06 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1219 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:08.811077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2df0499-3fcf-41af-9b91-3d56f8ff6b80 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Action: 'create', calling method: .version_select at 0x7fc5ccead940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349869968", "metadata": {"Type": "work"}}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2df0499-3fcf-41af-9b91-3d56f8ff6b80 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Request method failure captured: Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 122 Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf8_D5fNLA4oC4DEMsHX3p7-50SVxzRewQlKEm6uXTSaep7CYbeanUcdvblCYZY6-shPrbvmuDLtGYKusX1KVretEE9g-Xew4I3hyCQC6ewtrRNtJjx3ydZY2wuLDodoICq6Ves-IFEbHHFH4jhnmOcb5E28oQN_5Sba79o_UXMe24 Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:47:08.817940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 202224f89f274d398b34f9653bd769cc Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349869968", "metadata": {"Type": "work"}}} Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: Aug 24 15:47:08.819083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1349869968', 'metadata': {'Type': 'work'}}}} Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:08.819788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:47:08.821435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:47:08.822574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:47:08.822574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:08.838933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2df0499-3fcf-41af-9b91-3d56f8ff6b80 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:08.842306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c2df0499-3fcf-41af-9b91-3d56f8ff6b80 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.694149 Aug 24 15:47:08.848206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 19/35] 10.222.0.102 () {60 vars in 1161 bytes} [Wed Aug 24 15:47:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 702 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:08.858001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:08.862479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:08.882296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.886892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.889776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:08.894541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.896248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.896918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.032215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:09.034703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:09.035401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:09.036421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:09.038044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:09.073265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:09.077371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:09.079748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.083136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:09.087954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:09.089784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.160282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:09.173260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for user 2fe5724620da46ddbefbdfd442dc8d73 and project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:09.208152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:09.217360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:09.311094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1a7548a8-a829-4d2a-84f0-8fcc5856dd3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.914125 Aug 24 15:47:09.320780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 17/36] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:47:06 2022] POST /compute/v2.1/servers => generated 385 bytes in 2925 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:47:09.335664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a4002d11-c2cf-44e0-ae75-b958c4383ff2 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Action: 'create', calling method: .version_select at 0x7fc5cdeb65e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-224669987", "metadata": {"Type": "work"}}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a4002d11-c2cf-44e0-ae75-b958c4383ff2 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Request method failure captured: Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 119 Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf8_D5fNLA4oC4DEMsHX3p7-50SVxzRewQlKEm6uXTSaep7CYbeanUcdvblCYZY6-shPrbvmuDLtGYKusX1KVretEE9g-Xew4I3hyCQC6ewtrRNtJjx3ydZY2wuLDodoICq6Ves-IFEbHHFH4jhnmOcb5E28oQN_5Sba79o_UXMe24 Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:47:09.355866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 202224f89f274d398b34f9653bd769cc Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-224669987", "metadata": {"Type": "work"}}} Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: Aug 24 15:47:09.357351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-224669987', 'metadata': {'Type': 'work'}}}} Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi '0' Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:09.358029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:47:09.359399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:47:09.360699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:47:09.360699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.362640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a4002d11-c2cf-44e0-ae75-b958c4383ff2 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:09.365378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a4002d11-c2cf-44e0-ae75-b958c4383ff2 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.042085 Aug 24 15:47:09.368424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 18/37] 10.222.0.102 () {60 vars in 1161 bytes} [Wed Aug 24 15:47:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:09.388495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d9d701ef-84c3-4861-b7df-9635b46a8562 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:09.389239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d9d701ef-84c3-4861-b7df-9635b46a8562 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:09.873367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:09.923166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a2fe13f4-28b8-476a-9e1d-e0ebec95921b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1271 microversion: 2.1 time: 1.070332 Aug 24 15:47:09.925192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 20/38] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:08 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1271 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:09.946538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb468e7f-916f-4927-ace1-00629f167df1 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Action: 'create', calling method: .version_select at 0x7fc5cf200dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1235693709", "metadata": {"Type": "work"}}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb468e7f-916f-4927-ace1-00629f167df1 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Request method failure captured: Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 119 Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf8_D5fNLA4oC4DEMsHX3p7-50SVxzRewQlKEm6uXTSaep7CYbeanUcdvblCYZY6-shPrbvmuDLtGYKusX1KVretEE9g-Xew4I3hyCQC6ewtrRNtJjx3ydZY2wuLDodoICq6Ves-IFEbHHFH4jhnmOcb5E28oQN_5Sba79o_UXMe24 Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:47:09.960657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 202224f89f274d398b34f9653bd769cc Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1235693709", "metadata": {"Type": "work"}}} Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: Aug 24 15:47:09.961820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1235693709', 'metadata': {'Type': 'work'}}}} Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi '' Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:09.962466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:47:09.963503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:47:09.964544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:47:09.964544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:09.964544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb468e7f-916f-4927-ace1-00629f167df1 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:09.964544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eb468e7f-916f-4927-ace1-00629f167df1 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038193 Aug 24 15:47:09.966579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 21/39] 10.222.0.102 () {60 vars in 1161 bytes} [Wed Aug 24 15:47:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:09.997160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa13033f-8388-4141-9824-6d7ee2489941 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Calling method '.version_select at 0x7fc5ccd96a60>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:10.104970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-fa13033f-8388-4141-9824-6d7ee2489941 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] HTTP exception thrown: Volume tempest-invalid-84890368 could not be found. Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa13033f-8388-4141-9824-6d7ee2489941 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Request method failure captured: Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-84890368 HTTP/1.1 Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf8_D5fNLA4oC4DEMsHX3p7-50SVxzRewQlKEm6uXTSaep7CYbeanUcdvblCYZY6-shPrbvmuDLtGYKusX1KVretEE9g-Xew4I3hyCQC6ewtrRNtJjx3ydZY2wuLDodoICq6Ves-IFEbHHFH4jhnmOcb5E28oQN_5Sba79o_UXMe24 Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:47:10.109151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 202224f89f274d398b34f9653bd769cc Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Volume tempest-invalid-84890368 could not be found. Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'tempest-invalid-84890368'} Aug 24 15:47:10.110226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-84890368 could not be found. (HTTP 404) (Request-ID: req-5d43516a-d6bb-4bf3-b976-e57523266703) Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.110977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:47:10.119297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-84890368 could not be found. Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:10.120505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-84890368 could not be found. Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-84890368 could not be found. Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa13033f-8388-4141-9824-6d7ee2489941 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Returning 404 to user: Volume tempest-invalid-84890368 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa13033f-8388-4141-9824-6d7ee2489941 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/tempest-invalid-84890368" status: 404 len: 97 microversion: 2.1 time: 0.139225 Aug 24 15:47:10.121482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 22/40] 10.222.0.102 () {58 vars in 1217 bytes} [Wed Aug 24 15:47:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-84890368 => generated 97 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:47:10.131019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ab57903c-4e02-4e42-b827-f68302575116 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010746 Aug 24 15:47:10.131902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 23/41] 10.222.0.102 () {58 vars in 1145 bytes} [Wed Aug 24 15:47:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 15:47:10.145970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e4eda6bc-e608-4594-a8c6-5b4d955369ff tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006420 Aug 24 15:47:10.148405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 24/42] 10.222.0.102 () {58 vars in 1142 bytes} [Wed Aug 24 15:47:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 15:47:10.159408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce86fb23-f55d-48e2-ac5f-f243f5984082 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Calling method '.version_select at 0x7fc5ccd81280>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:10.253603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-ce86fb23-f55d-48e2-ac5f-f243f5984082 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] HTTP exception thrown: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce86fb23-f55d-48e2-ac5f-f243f5984082 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Request method failure captured: Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: DELETE /compute/v2.1/os-volumes/b4eff835-c22b-4b9c-9b0e-4acb09db60d3 HTTP/1.1 Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf8_D5fNLA4oC4DEMsHX3p7-50SVxzRewQlKEm6uXTSaep7CYbeanUcdvblCYZY6-shPrbvmuDLtGYKusX1KVretEE9g-Xew4I3hyCQC6ewtrRNtJjx3ydZY2wuLDodoICq6Ves-IFEbHHFH4jhnmOcb5E28oQN_5Sba79o_UXMe24 Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:47:10.255567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 202224f89f274d398b34f9653bd769cc Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'b4eff835-c22b-4b9c-9b0e-4acb09db60d3'} Aug 24 15:47:10.256911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. (HTTP 404) (Request-ID: req-e915cd31-1b9a-4dd5-afb6-dcab4f2850b1) Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.257583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:47:10.258910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:47:10.262076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce86fb23-f55d-48e2-ac5f-f243f5984082 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Returning 404 to user: Volume b4eff835-c22b-4b9c-9b0e-4acb09db60d3 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ce86fb23-f55d-48e2-ac5f-f243f5984082 tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/b4eff835-c22b-4b9c-9b0e-4acb09db60d3" status: 404 len: 109 microversion: 2.1 time: 0.101795 Aug 24 15:47:10.264082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 25/43] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:47:10 2022] DELETE /compute/v2.1/os-volumes/b4eff835-c22b-4b9c-9b0e-4acb09db60d3 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:47:10.276509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-36e479b8-3be6-4f9b-9b9a-57d27f6c57fb tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Calling method '.version_select at 0x7fc5ccd96280>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:10.362380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-36e479b8-3be6-4f9b-9b9a-57d27f6c57fb tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] HTTP exception thrown: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-36e479b8-3be6-4f9b-9b9a-57d27f6c57fb tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Request method failure captured: Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/os-volumes/b7824d6e-bf69-43bb-ab68-4dcbb44c300f HTTP/1.1 Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf8_D5fNLA4oC4DEMsHX3p7-50SVxzRewQlKEm6uXTSaep7CYbeanUcdvblCYZY6-shPrbvmuDLtGYKusX1KVretEE9g-Xew4I3hyCQC6ewtrRNtJjx3ydZY2wuLDodoICq6Ves-IFEbHHFH4jhnmOcb5E28oQN_5Sba79o_UXMe24 Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:47:10.365022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ce7dce2a40e945f6be112ac8733b8b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: ce7dce2a40e945f6be112ac8733b8b5f Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-VolumesNegativeTest-364279073 Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 202224f89f274d398b34f9653bd769cc Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-VolumesNegativeTest-364279073-project Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'b7824d6e-bf69-43bb-ab68-4dcbb44c300f'} Aug 24 15:47:10.366331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. (HTTP 404) (Request-ID: req-638bf256-08c6-4b71-804c-b10a7e81e557) Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.367137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:47:10.368878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:47:10.370033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. Aug 24 15:47:10.371183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:47:10.374568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-36e479b8-3be6-4f9b-9b9a-57d27f6c57fb tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] Returning 404 to user: Volume b7824d6e-bf69-43bb-ab68-4dcbb44c300f could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:10.374568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-36e479b8-3be6-4f9b-9b9a-57d27f6c57fb tempest-VolumesNegativeTest-364279073 tempest-VolumesNegativeTest-364279073-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/b7824d6e-bf69-43bb-ab68-4dcbb44c300f" status: 404 len: 109 microversion: 2.1 time: 0.108450 Aug 24 15:47:10.375685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 26/44] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 15:47:10 2022] GET /compute/v2.1/os-volumes/b7824d6e-bf69-43bb-ab68-4dcbb44c300f => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:10.429660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d9d701ef-84c3-4861-b7df-9635b46a8562 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:10.463013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d9d701ef-84c3-4861-b7df-9635b46a8562 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1226 microversion: 2.1 time: 1.093119 Aug 24 15:47:10.494933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 19/45] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:09 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1226 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:10.945873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:10.947310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:10.967962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:10.978628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:10.984415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:10.987659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:10.988602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:10.991907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:11.486790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:11.487512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:11.492999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:11.501389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:11.501887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:11.511200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0c38d284-b076-4d9f-bc9b-29f51826fbff tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1277 microversion: 2.1 time: 0.563181 Aug 24 15:47:11.525228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:11.525694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 27/46] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:10 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1277 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:11.525779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:11.525779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:11.525779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:12.538624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:12.540389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:12.569314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:12.573040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:12.575723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:12.578325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:12.582814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:12.583843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:13.121576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:13.169303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c80d7ed7-1991-4ae4-9e21-8e05769a8aeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1278 microversion: 2.1 time: 1.686357 Aug 24 15:47:13.189706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 20/47] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:11 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1278 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:13.205066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:13.242931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:13.263200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-858ce167-79d8-465f-bdb8-a26556fd592b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1277 microversion: 2.1 time: 0.732476 Aug 24 15:47:13.266878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 28/48] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:12 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1277 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:13.279343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-684973725", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98cb2623-043e-451b-8b73-9ccca3fc016c"}], "security_groups": [{"name": "tempest-securitygroup--741616335"}], "key_name": "tempest-keypair-379967176", "user_data": "}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:14.056279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] validate_networks() for [('98cb2623-043e-451b-8b73-9ccca3fc016c', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:47:14.197599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:14.198277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:14.211669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:14.212274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:14.212714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.213431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:14.213885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:14.214306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.529069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:14.546115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a86b725-10da-42f3-ab12-56e65ecf85e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1284 microversion: 2.1 time: 0.351627 Aug 24 15:47:14.564959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 29/49] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:14 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:14.589724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1891806663", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de13cd90-f905-4ac9-8ee2-d6bd6b9d1ec9"}], "security_groups": [{"name": "tempest-securitygroup--1405182300"}], "key_name": "tempest-keypair-1695529222", "user_data": "}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:15.080370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] validate_networks() for [('de13cd90-f905-4ac9-8ee2-d6bd6b9d1ec9', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:47:16.651593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:16.652763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:16.653282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:16.656040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:16.656515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:16.688092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.690523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.692827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.693924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.694566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.696650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.765849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:16.785572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:16.786766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:16.787444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:16.789134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:16.789626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for user 38f7d31cf0f541f58af7d3d850af6472 and project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:16.791714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:16.810774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.811495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.812160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.813014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.813918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.814522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.839388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:16.850580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:16.872109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:16.883602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for user c058b07c1e9e443ebacbf38b1f13e58b and project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:16.912940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:16.924208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:16.983277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-46bb2da6-4a11-49ca-9658-e1fb4013fe96 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.414262 Aug 24 15:47:16.984406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 30/50] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:47:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:47:17.037768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:17.044695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:17.059766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.062302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.064475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.069417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.073432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.076434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.111821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-70fbc0f9-5ae8-41b5-9da4-aeb03ddb3016 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 3.841604 Aug 24 15:47:17.112732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 21/51] 10.222.0.102 () {62 vars in 1193 bytes} [Wed Aug 24 15:47:13 2022] POST /compute/v2.1/servers => generated 403 bytes in 3844 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 15:47:17.143121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:17.168315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:17.189524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.198262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.200070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.201799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.203799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.209204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.742093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:17.799850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-11f512d8-5129-47d1-abe5-0bb89c6d9646 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.814018 Aug 24 15:47:17.807360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 31/52] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:16 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:17.823510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:17.836959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3156289a-ff82-4b5f-871d-39792eb99c21 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.706100 Aug 24 15:47:17.837927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 22/53] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:17 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:17.849608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-69076be2-e371-49c5-8108-78540fcf914c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:17.850351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-69076be2-e371-49c5-8108-78540fcf914c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:17.850979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-487d7a5c-c36f-4a83-9be8-c3136e813844 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:17.851737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-487d7a5c-c36f-4a83-9be8-c3136e813844 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:18.169301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-69076be2-e371-49c5-8108-78540fcf914c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:18.176890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-69076be2-e371-49c5-8108-78540fcf914c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1242 microversion: 2.1 time: 0.366891 Aug 24 15:47:18.191512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-487d7a5c-c36f-4a83-9be8-c3136e813844 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:18.192386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 32/54] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:17 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1242 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:18.209860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-487d7a5c-c36f-4a83-9be8-c3136e813844 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:18.224073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-487d7a5c-c36f-4a83-9be8-c3136e813844 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:18.228039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-487d7a5c-c36f-4a83-9be8-c3136e813844 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1284 microversion: 2.20 time: 0.387667 Aug 24 15:47:18.230956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 23/55] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1284 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:18.833745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:18.834423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:18.856969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:18.860584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:18.861056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:18.865254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:18.865749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:18.866194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:18.869330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:18.870606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:18.901178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:18.903246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:18.905059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:18.908036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:18.908550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:18.908998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:19.698221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:19.709936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f5cf86a-ee06-4f0a-8d76-f7fd03bc192d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.853889 Aug 24 15:47:19.725260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 24/56] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:18 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:19.735140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:19.740205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:19.756111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:19.756111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:19.756361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:19.756937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:19.760872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:19.761558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:19.791557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:19.806340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4cb8498e-8506-4202-a19c-895ef4701f29 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.978335 Aug 24 15:47:19.807473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 33/57] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:18 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:19.820807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:19.823376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:19.841880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:19.845083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:19.845865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:19.848944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:19.852580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:19.853542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:19.991956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:20.002341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aedec459-7904-457d-ac5e-f47e6a651fe1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1294 microversion: 2.1 time: 0.275545 Aug 24 15:47:20.008415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 25/58] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:19 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1294 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:20.054098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:20.074865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:20.077675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:20.078920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8aa1e588-e602-4306-b6a6-f986e8758314 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1336 microversion: 2.20 time: 0.268360 Aug 24 15:47:20.085141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 34/59] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1336 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:20.732261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:20.733189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:20.761036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:20.761036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:20.761036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:20.761036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:20.761503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:20.761503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.611703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0993cf-1281-4dd9-a365-c3f602300088", "tag": "56b38b5a-983e-4b27-b9a7-54fe664029a0"}, {"name": "network-changed", "server_uuid": "3b76a210-7149-41db-9f03-84c996c8ee63", "tag": "8c58563e-d765-4da9-a6dc-e72ac2dc33ab"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:21.638238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:21.640348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.641100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.641733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.651831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2809e894-cdf9-4953-a9ce-6412a9f3e558 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.920107 Aug 24 15:47:21.665046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 35/60] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:20 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:21.665046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:21.665046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:21.674971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.675469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.675965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.676679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.677132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.680502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.702923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Creating event network-changed:56b38b5a-983e-4b27-b9a7-54fe664029a0 for instance 9c0993cf-1281-4dd9-a365-c3f602300088 on hv-cinder-84932 Aug 24 15:47:21.703695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Creating event network-changed:8c58563e-d765-4da9-a6dc-e72ac2dc33ab for instance 3b76a210-7149-41db-9f03-84c996c8ee63 on hv-cinder-84932 Aug 24 15:47:21.704554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 15:47:21.706059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-76dfa759-4bcd-4db2-aa3e-10ce3adb4abc req-4ea923a3-67ed-43f0-b25c-2846521f6c72 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 15:47:21.708845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.711971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.712647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.713622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.714834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.716132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.737642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.compute.rpcapi [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 15:47:21.743379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] Releasing lock "compute-rpcapi-router" {{(pid=132518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 15:47:21.783818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6a56fcc6-4cef-48f7-b165-6243248f4acb None None] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 1.139797 Aug 24 15:47:21.785094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 26/61] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:21.795853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:21.796825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:21.815408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.817757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.821257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:21.824076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:21.824754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:21.826494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:22.137170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:22.158823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-056e7a81-4651-47e5-875a-f5a14ed6ab07 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1312 microversion: 2.1 time: 0.368427 Aug 24 15:47:22.162920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 27/62] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:21 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1312 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:22.170656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:22.189515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:22.219990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:22.221134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:22.222063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:22.223131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:22.223827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:22.224615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:22.334741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:22.352541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c43da033-932c-4f3c-833d-3802cad3aa75 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.697648 Aug 24 15:47:22.369417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 36/63] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:21 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:22.550641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:22.564544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:22.573460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:22.575085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c9ec22e-8f25-479d-bf69-b5318f045218 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1342 microversion: 2.20 time: 0.410714 Aug 24 15:47:22.575944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 28/64] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1342 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:22.673524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:22.674452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:22.702046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:22.705078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:22.708655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:22.711505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:22.718077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:22.728698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:23.185545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:23.186737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:23.203840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:23.208364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:23.209129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:23.215991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:23.217055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:23.217685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:23.595203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:23.605456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-94132756-289f-4ebf-afbe-fa5d333c45a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1300 microversion: 2.1 time: 0.426229 Aug 24 15:47:23.611095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 29/65] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:23 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1300 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:23.626682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:23.630166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:23.643066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:23.647656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:23.649903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:23.651114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:23.651823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:23.657361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:24.154228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:24.164768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-06c58f7f-c186-4469-a475-4ffdfd62dc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 1.494850 Aug 24 15:47:24.165362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 37/66] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:22 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:24.183296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:24.183944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:24.199753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:24.200222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:24.202308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:24.204664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:24.205958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:24.207382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:24.270729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:24.282891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-93a916d5-b540-41e3-b090-a9431575d29b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.669545 Aug 24 15:47:24.285517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 30/67] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:23 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:24.296193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-fbc1f6eb-0633-4b44-a2dd-11a00b37c3d5 req-9f9bdc3d-fa6d-451f-b2c1-0106ecd4d5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "253aedec-4338-4cde-8059-862a76ca4202", "tag": "3deb4c39-af46-406b-9dd9-8450fa0166df"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:24.323043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-fbc1f6eb-0633-4b44-a2dd-11a00b37c3d5 req-9f9bdc3d-fa6d-451f-b2c1-0106ecd4d5f0 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:24.323898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-fbc1f6eb-0633-4b44-a2dd-11a00b37c3d5 req-9f9bdc3d-fa6d-451f-b2c1-0106ecd4d5f0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:24.324635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-fbc1f6eb-0633-4b44-a2dd-11a00b37c3d5 req-9f9bdc3d-fa6d-451f-b2c1-0106ecd4d5f0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:24.351031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-fbc1f6eb-0633-4b44-a2dd-11a00b37c3d5 req-9f9bdc3d-fa6d-451f-b2c1-0106ecd4d5f0 service nova] Creating event network-changed:3deb4c39-af46-406b-9dd9-8450fa0166df for instance 253aedec-4338-4cde-8059-862a76ca4202 on hv-cinder-84932 Aug 24 15:47:24.369126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-fbc1f6eb-0633-4b44-a2dd-11a00b37c3d5 req-9f9bdc3d-fa6d-451f-b2c1-0106ecd4d5f0 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079914 Aug 24 15:47:24.370156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 31/68] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:24.420014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:24.437030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:24.438622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:24.439904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-05129847-1c8f-4ffb-a9d0-f24e7524c37e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1342 microversion: 2.20 time: 0.273561 Aug 24 15:47:24.440475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 38/69] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:24.632270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:24.633888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:24.661393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:24.661914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:24.662358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:24.663081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:24.663543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:24.664044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:25.017749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:25.029546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-325416ed-1694-4fdc-b97e-41e21e805c46 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1300 microversion: 2.1 time: 0.401430 Aug 24 15:47:25.044782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 32/70] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:24 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1300 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:25.190998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:25.192256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:25.203747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:25.204574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:25.205021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:25.206272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:25.207073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:25.207510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:25.317108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:25.319392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:25.337595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:25.338664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:25.339831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:25.341105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:25.342384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:25.343167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:25.593104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:25.603152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=75 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:25.609697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cb379cef-3985-4f39-9cc6-1c7460d9c4db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.425232 Aug 24 15:47:25.627531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 39/71] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:25 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:25.627531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:25.627531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:25.632685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:25.662491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f7d7aa1e-ddd7-4446-a842-b162fe14c57d tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.353268 Aug 24 15:47:25.666451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 33/72] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:25 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:25.666994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:25.674554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:25.675070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:25.675670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:25.676403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:25.676863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:25.677290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.001592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:26.014432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:26.020771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:26.025458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0739e967-d78f-4b2d-b6b2-b1939364305b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.407144 Aug 24 15:47:26.026449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 40/73] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:26.056537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:26.059872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:26.075813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:26.077017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:26.078576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.081146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:26.083618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:26.084255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.225689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:26.233956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-86ae6bd0-2bfe-4446-8c38-fee2cd778aed tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1300 microversion: 2.1 time: 0.186173 Aug 24 15:47:26.248264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 34/74] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:26 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:26.636426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:26.638222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:26.681976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:26.682898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:26.683536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.685669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:26.686424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:26.686897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:26.688111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:26.692311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.698874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:26.699413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:26.702670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.705822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:26.709123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:26.711523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:26.736044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:27.170980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:27.173810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=83 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:27.182341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ed98b2e-2bb3-4fae-b82e-2b2e17c1ee24 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.500468 Aug 24 15:47:27.183177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 35/75] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:26 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:27.202443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:27.203401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:27.208644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:27.211711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:27.214606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:27.215395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:27.215890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:27.216760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:27.217965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:27.218598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b78ca3c-85d2-4edd-a078-f28a61e4234c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.587348 Aug 24 15:47:27.219178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 41/76] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:26 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:27.219292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:27.257316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:27.258771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:27.287386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:27.289361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:27.290969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:27.292221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:27.293382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:27.294085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:27.598792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:27.615268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:27.618605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:27.624140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-03385619-51b0-4d3f-90a5-f3192c9a977e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.436921 Aug 24 15:47:27.626682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 36/77] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:27.661721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:27.672377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee92d9e4-df1e-4ec3-8a1a-c96099130f7f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.419876 Aug 24 15:47:27.674908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 42/78] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:27 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:28.205757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:28.206182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:28.212673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=22 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:28.218321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.219180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.221381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.224715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.225431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.228811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.243279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:28.243951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:28.247994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=28 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:28.260851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.261557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.262007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.262724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.263600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.264063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.618031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:28.626889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a3671c41-70bd-41d7-afed-74f84e4e8a7e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.426551 Aug 24 15:47:28.629164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 37/79] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:28 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:28.649778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:28.650106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:28.662408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.662910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.663346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.664627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.669527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.674347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.687543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:28.705472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86c200e2-d96c-4bc3-87cd-540e025aceff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.466110 Aug 24 15:47:28.707711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 43/80] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:28 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:28.722799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:28.724777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:28.739089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.744305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.745333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:28.746326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:28.747828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:28.750311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.298023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:29.314721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa413d8a-67b5-4baa-a2ef-f59ae32eeb56 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.603647 Aug 24 15:47:29.326097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 44/81] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:28 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:29.331228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f1a7c0-a412-40d4-9809-6cbc75cae9a2", "tag": "509dd32c-8be1-4c88-a113-55950e314a5a"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:29.355508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:29.360063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.361703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.362325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.365051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:29.367516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:29.368936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5aecfc73-1eb9-44dc-b195-8320c05c2e73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.724096 Aug 24 15:47:29.386212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 38/82] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:29.411552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Creating event network-changed:509dd32c-8be1-4c88-a113-55950e314a5a for instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 on hv-cinder-84932 Aug 24 15:47:29.413109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 15:47:29.416202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-a9174a98-fa51-45d2-aef0-720329dd49b3 req-bd3d81cb-8962-41d5-83a1-a0135a7ab36c service nova] Acquired lock "compute-rpcapi-router" {{(pid=132517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 15:47:29.419498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.420534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.428270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.430239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.432184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.433224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.450501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.compute.rpcapi [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 15:47:29.452019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] Releasing lock "compute-rpcapi-router" {{(pid=132517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 15:47:29.497200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-da4d3c34-6a27-46a3-a61e-c7f060c43b7f None None] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169529 Aug 24 15:47:29.498369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 45/83] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:29.655410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:29.656157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:29.663670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.664940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.665534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.666933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.667380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.668025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.817492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:29.834058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71e9b310-5095-490b-bc36-fdc6cae0a571 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.186678 Aug 24 15:47:29.840175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 46/84] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:29 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:29.858553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:29.859856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:29.871331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.872456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.873130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.874213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.883671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.884362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:29.937820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-8bd123bc-4343-4e94-9efb-ea5fd1009eef req-68d3d1fd-90a7-4e9c-b6c2-0328ef69a6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:29.967933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8bd123bc-4343-4e94-9efb-ea5fd1009eef req-68d3d1fd-90a7-4e9c-b6c2-0328ef69a6ec service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:29.968420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8bd123bc-4343-4e94-9efb-ea5fd1009eef req-68d3d1fd-90a7-4e9c-b6c2-0328ef69a6ec service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:29.968847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8bd123bc-4343-4e94-9efb-ea5fd1009eef req-68d3d1fd-90a7-4e9c-b6c2-0328ef69a6ec service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:30.006970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-8bd123bc-4343-4e94-9efb-ea5fd1009eef req-68d3d1fd-90a7-4e9c-b6c2-0328ef69a6ec service nova] Creating event network-changed:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 15:47:30.019048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-8bd123bc-4343-4e94-9efb-ea5fd1009eef req-68d3d1fd-90a7-4e9c-b6c2-0328ef69a6ec service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.470627 Aug 24 15:47:30.019883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 39/85] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:30.287500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:30.299100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c0cb91a5-0265-4b92-9c8c-f1b1fd9518c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.456950 Aug 24 15:47:30.301028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 47/86] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:29 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:30.356411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:30.358145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:30.374396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:30.375285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:30.375839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:30.380150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:30.380749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:30.381313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:30.393234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:30.393953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:30.413674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:30.415976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:30.416514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:30.424083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:30.424633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:30.425071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:30.941095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:30.944359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:30.946586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:30.947823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dfac4244-9442-466d-8027-6612f763d5fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.558369 Aug 24 15:47:30.962603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 48/87] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:30.965132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:30.966012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:30.968350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:30.973902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:30.977162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:30.978286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-be893c9e-7416-4c8c-b537-fab07b956b36 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.628038 Aug 24 15:47:30.978981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:30.979262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 40/88] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:30 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:30.981053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:30.993109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:30.993792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:31.281995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:31.291315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2a332e66-d045-49a9-ac90-3d317ef98346 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.341879 Aug 24 15:47:31.296330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 49/89] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:30 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:31.323703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:31.324579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:31.336725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:31.340491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:31.341105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:31.341999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:31.343441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:31.345436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:31.541653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:31.550920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-049fa7db-72b0-44cc-9b84-43ddaff1d4d3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.232745 Aug 24 15:47:31.565173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 41/90] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:31 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:31.975429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:31.977570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:31.986508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:31.988609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:31.990941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:31.991894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:31.995718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:31.998672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.002287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:32.003074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:32.014794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=8 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:32.019414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.020167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.021310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.024372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.026275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.026960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.541722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:32.562204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:32.566072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:32.573603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ae4f7220-6740-451e-9a5b-8f800d7ad3d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.597319 Aug 24 15:47:32.574485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 50/91] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:32.646753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:32.659596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1400fc57-36d6-48e5-990e-0e4dd6a93189 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.662322 Aug 24 15:47:32.672512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 42/92] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:31 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:32.686563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:32.687689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:32.696699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.697514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.698151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.699213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.699693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.700240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.905801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-6990a91c-a555-472a-92d0-2cc24efdb591 req-f3fd35af-60f7-46e4-ad53-d05ddb6e1e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0993cf-1281-4dd9-a365-c3f602300088", "name": "network-vif-plugged", "status": "completed", "tag": "56b38b5a-983e-4b27-b9a7-54fe664029a0"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:32.907612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:32.920990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-11909dee-01d0-4795-bc82-cbe13a45dcf3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.246808 Aug 24 15:47:32.922464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 43/93] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:32 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:32.926892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-6990a91c-a555-472a-92d0-2cc24efdb591 req-f3fd35af-60f7-46e4-ad53-d05ddb6e1e3b service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.928030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-6990a91c-a555-472a-92d0-2cc24efdb591 req-f3fd35af-60f7-46e4-ad53-d05ddb6e1e3b service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.928901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-6990a91c-a555-472a-92d0-2cc24efdb591 req-f3fd35af-60f7-46e4-ad53-d05ddb6e1e3b service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.940001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:32.940951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:32.954755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-6990a91c-a555-472a-92d0-2cc24efdb591 req-f3fd35af-60f7-46e4-ad53-d05ddb6e1e3b service nova] Creating event network-vif-plugged:56b38b5a-983e-4b27-b9a7-54fe664029a0 for instance 9c0993cf-1281-4dd9-a365-c3f602300088 on hv-cinder-84932 Aug 24 15:47:32.957911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.958491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.959002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.959957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:32.960415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:32.960996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:32.961181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-6990a91c-a555-472a-92d0-2cc24efdb591 req-f3fd35af-60f7-46e4-ad53-d05ddb6e1e3b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383460 Aug 24 15:47:32.961779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 51/94] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:33.387219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:33.395301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc923ed5-d66b-4590-b592-df70e3cd1dd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.471340 Aug 24 15:47:33.400392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 44/95] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:32 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:33.598706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:33.599407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:33.620369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:33.622031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:33.622784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:33.624651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:33.627443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:33.628467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:33.688301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:33.689016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:33.709041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:33.710268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:33.712630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:33.715363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:33.718304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:33.720697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:34.228950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:34.235271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:34.238818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:34.240356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:34.241476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb0cd3a4-4ccb-4d3d-aa22-07b6e35a4f6d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.646895 Aug 24 15:47:34.242088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 52/96] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:34.244056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e107bec3-1ee0-4d8c-9b2e-14ed5e17d645 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.559954 Aug 24 15:47:34.244618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 45/97] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:33 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:34.253511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:34.254341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:34.260943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:34.261439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:34.261872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:34.262564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:34.263015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:34.263439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:34.392633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:34.401010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-21325f09-d76b-44ca-82fb-8d6d65c1470c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.151059 Aug 24 15:47:34.401576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 53/98] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:34 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:34.424388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:34.424988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:34.432272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:34.432763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:34.433200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:34.433943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:34.434406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:34.434831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:34.575336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:34.582929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ad39fbc2-37c6-4a3f-a61f-4c9517654e72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.162360 Aug 24 15:47:34.583485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 46/99] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:34 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:34.975909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-05490c65-ded8-4c0a-b498-d8e2fbf42f39 req-010e94d2-4026-4607-9441-c7c3d8a21d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b76a210-7149-41db-9f03-84c996c8ee63", "name": "network-vif-plugged", "status": "completed", "tag": "8c58563e-d765-4da9-a6dc-e72ac2dc33ab"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:34.986289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-05490c65-ded8-4c0a-b498-d8e2fbf42f39 req-010e94d2-4026-4607-9441-c7c3d8a21d98 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:34.986765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-05490c65-ded8-4c0a-b498-d8e2fbf42f39 req-010e94d2-4026-4607-9441-c7c3d8a21d98 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:34.987199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-05490c65-ded8-4c0a-b498-d8e2fbf42f39 req-010e94d2-4026-4607-9441-c7c3d8a21d98 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:34.998105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-05490c65-ded8-4c0a-b498-d8e2fbf42f39 req-010e94d2-4026-4607-9441-c7c3d8a21d98 service nova] Creating event network-vif-plugged:8c58563e-d765-4da9-a6dc-e72ac2dc33ab for instance 3b76a210-7149-41db-9f03-84c996c8ee63 on hv-cinder-84932 Aug 24 15:47:35.003065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-05490c65-ded8-4c0a-b498-d8e2fbf42f39 req-010e94d2-4026-4607-9441-c7c3d8a21d98 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 Aug 24 15:47:35.003669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 54/100] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:35.264758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:35.265587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:35.265708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:35.266317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:35.272239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.272722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.272848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.273160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.273292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.273852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.274331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.274443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.274851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.275050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.275804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.276239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.469797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:35.473801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:35.477405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ded13c77-c226-47d6-b68a-946084b68259 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.216372 Aug 24 15:47:35.477977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 47/101] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:35 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:35.482428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:35.482567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:35.483077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:35.484057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:35.485255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee04fb22-1a21-4910-9d32-93a1f5e3067e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.223726 Aug 24 15:47:35.485724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 55/102] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:35.493405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.494075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.494539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.495262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.495742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.496163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.603590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:35.604240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:35.610111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.610595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.611028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.611741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:35.612198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:35.612616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:35.626382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:35.634598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9dd8d4fd-0dcc-4147-bca0-d9e24435322e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.155601 Aug 24 15:47:35.635169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 48/103] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:35 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:35.745163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:35.752875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8a03d9da-d248-4843-88f6-c1a8bb66e285 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.153827 Aug 24 15:47:35.753442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 56/104] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:35 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:36.498186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:36.498790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:36.504797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.505275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.505702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.506389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.506832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.507352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.507836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:36.508603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:36.514610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.515091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.515525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.516252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.516704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.517127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.699408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:36.703611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:36.707353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-54581c1d-f9e8-485b-8c6e-43adec36ce53 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.212840 Aug 24 15:47:36.707982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 49/105] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:36 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:36.712821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:36.713519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:36.714207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:36.714357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:36.715668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-da44bc13-96e7-483d-9ad0-9986c37739d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.211868 Aug 24 15:47:36.716230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 57/106] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:36.720348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.720844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.721363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.722063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.722514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.722935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.774642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:36.775217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:36.781473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.782004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.782624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.783515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:36.784168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:36.784757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:36.791734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:36.907516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:36.919296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dcb818c6-4ba7-4a7c-b902-4c3c44baa403 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.210091 Aug 24 15:47:36.919921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 50/107] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:36 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:36.953393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:36.961046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b6adf05-9d1e-4f37-aa8e-5b147b794d70 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.191050 Aug 24 15:47:36.961717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 58/108] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:36 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:37.729138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:37.729689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:37.735827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.736312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.736745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.737468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.737924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.738159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:37.738573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.738778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:37.745307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.745823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.746260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.746957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.747421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.747879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.941073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:37.944840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:37.949943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ef2a8956-7b0c-496b-96ea-99053c5c8ce9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.225441 Aug 24 15:47:37.950529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 51/109] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:37 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:37.953897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:37.954909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:37.955453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:37.955689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:37.956605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3155cff5-3830-4ae7-86cc-a78beee23a4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.222313 Aug 24 15:47:37.957135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 59/110] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:37.962947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.963439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.963902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.964597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.965053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.965476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.982077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:37.982610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:37.988568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.989061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.989500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:37.990228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:37.990685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:37.991110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:38.180734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:38.187932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:38.198028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-146f0449-1c77-431b-89c5-50f89d04e5d5 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.246421 Aug 24 15:47:38.198229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de4e7296-410a-46ce-8daa-27d36525b255 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.219813 Aug 24 15:47:38.198763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 60/111] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:37 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:38.199177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 52/112] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:37 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:38.970577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:38.971179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:38.977923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:38.978403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:38.978830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:38.979521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:38.980011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:38.980434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:38.981099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:38.981721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:38.987761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:38.988307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:38.988689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:38.989381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:38.989836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:38.990261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:38.993532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:39.178909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:39.182092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:39.187052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c59008bc-03a2-4584-88d4-63781026f85c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.220249 Aug 24 15:47:39.187623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 61/113] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:38 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:39.190350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:39.191889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:39.193248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a5e2fda-d18b-4102-a0d3-84952ff29826 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.217118 Aug 24 15:47:39.193794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 53/114] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:39.218074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:39.218679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:39.218812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:39.219424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:39.224554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:39.225035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:39.225362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:39.225456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:39.225851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:39.226147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:39.226338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:39.227620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:39.227767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:39.227971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:39.228141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:39.228569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:39.432096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:39.434594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:39.444384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4676632b-5839-4d12-861a-7056d434b06f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.229882 Aug 24 15:47:39.445999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 62/115] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:39 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:39.454137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12d34ef1-79e3-4bf6-81b6-0de720d2e8c3 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.238902 Aug 24 15:47:39.459954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 54/116] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:39 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:40.207712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:40.208354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:40.210164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:40.216163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:40.216607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.216782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:40.216915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.217299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.217990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.218445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.218870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.222627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.223111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.223547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.224277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.224822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.225347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.412462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:40.417077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:40.425762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:40.427317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-46b6bc3d-1209-4ccf-b057-cbd22f044c88 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.223323 Aug 24 15:47:40.427434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:40.428034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 63/117] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:40 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:40.428570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc5922c9-24bc-45c1-822c-bd22bf95062e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.217234 Aug 24 15:47:40.429197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 55/118] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:40.467335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:40.467979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:40.474546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.475040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.475470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.476329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.477471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.477606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:40.477914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.478195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:40.484950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.485435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.485877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.486561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:40.487012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:40.487431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:40.681248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:40.688867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b2a86886-d21d-489e-937d-d54f362ec071 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.225838 Aug 24 15:47:40.689443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 64/119] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:40 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:40.704979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:40.712641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-239b064f-2f20-4a58-b22a-ad5a5ab19f4c tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.240749 Aug 24 15:47:40.713214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 56/120] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:40 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:41.450703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:41.451470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:41.451771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:41.452999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:41.460470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.461661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.462324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.462740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.463241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.463349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.463705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.463808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.464144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.464411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.465032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.465711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.669764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:41.689109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:41.690853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:41.692037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b4d2e18a-dd79-4fad-96c8-b6de965f856b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.244128 Aug 24 15:47:41.693260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 57/121] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:41.710057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:41.710935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:41.711042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:41.717945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.718498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.718857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0eda309b-8a22-413c-8333-b0e6ca3eb501 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.272221 Aug 24 15:47:41.719207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.719792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 65/122] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:41 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:41.720246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.720835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.721321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.735855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:41.735855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:41.744494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.744991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.745826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.746535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:41.746995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:41.747419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:41.943109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:41.946575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:41.953011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-52f1ef79-ea78-40c9-a47a-d4342544ad41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.246611 Aug 24 15:47:41.953968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 58/123] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:41 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:41.955291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e78fb5ef-b24e-46fe-81e5-8a1d5ea36693 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.225545 Aug 24 15:47:41.956135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 66/124] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:41 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:42.726422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:42.727147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:42.733564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.734119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.734652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.735416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.736096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.736523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.741784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:42.742896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:42.748782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.749275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.749712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.750404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.750864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.751289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.937621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:42.943605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:42.947326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:42.952080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad27db1d-8b41-4956-8b27-0a8fcf2ee59b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.215561 Aug 24 15:47:42.952633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:42.952755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 67/125] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:42 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:42.953780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1444941b-2e6b-4414-ab58-e6408f457075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.239851 Aug 24 15:47:42.954336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 59/126] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:42.974820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:42.975439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:42.977981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:42.979215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:42.983307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.983840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.984501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.985401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.985863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.986323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.987948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.988673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.989246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:42.989975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:42.990560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:42.990988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:43.186249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:43.189075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:43.194223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5cf3a910-3d39-43d4-844e-3207091db2e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.223752 Aug 24 15:47:43.194799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 68/127] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:42 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:43.197102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-de449d3b-0669-45b8-9ede-b0b47e408e0e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.224052 Aug 24 15:47:43.197735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 60/128] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:42 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:43.453727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-3f56349b-1212-49d2-b348-14ce1c8cb799 req-dd6db016-55d2-43d7-9660-083206aef8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253aedec-4338-4cde-8059-862a76ca4202", "name": "network-vif-plugged", "status": "completed", "tag": "3deb4c39-af46-406b-9dd9-8450fa0166df"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:43.470747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-3f56349b-1212-49d2-b348-14ce1c8cb799 req-dd6db016-55d2-43d7-9660-083206aef8ca service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:43.473006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-3f56349b-1212-49d2-b348-14ce1c8cb799 req-dd6db016-55d2-43d7-9660-083206aef8ca service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:43.473687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-3f56349b-1212-49d2-b348-14ce1c8cb799 req-dd6db016-55d2-43d7-9660-083206aef8ca service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:43.487266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-3f56349b-1212-49d2-b348-14ce1c8cb799 req-dd6db016-55d2-43d7-9660-083206aef8ca service nova] Creating event network-vif-plugged:3deb4c39-af46-406b-9dd9-8450fa0166df for instance 253aedec-4338-4cde-8059-862a76ca4202 on hv-cinder-84932 Aug 24 15:47:43.494785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-3f56349b-1212-49d2-b348-14ce1c8cb799 req-dd6db016-55d2-43d7-9660-083206aef8ca service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044268 Aug 24 15:47:43.495797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 69/129] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:43.975928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:43.977887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:43.980230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:43.980947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:43.986365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:43.987015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:43.987500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:43.987948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:43.988090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:43.988450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:43.989157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:43.989439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:43.989617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:43.990045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:43.990423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:43.990988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:44.205469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:44.238990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:44.240476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:44.241600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b60ae07d-d464-4230-a5a4-250f04a0210b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.266828 Aug 24 15:47:44.252843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 70/130] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:44.269423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:44.270378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:44.278399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:44.279020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:44.279518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:44.280394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:44.280915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:44.281403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:44.294705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:44.307525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-73198aa2-1c6c-4f50-b8a0-eaf0e18ad393 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.335087 Aug 24 15:47:44.322601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 61/131] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:43 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:44.331089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:44.331961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:44.339569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:44.340082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:44.340509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:44.341466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:44.342128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:44.342549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:44.480677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:44.489401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e99f4941-8254-4f51-b53e-7995f107bc79 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.224511 Aug 24 15:47:44.489975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 71/132] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:44 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:44.527514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:44.538563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b8924dfe-aa8e-471d-a509-2829e9ba36dc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1319 microversion: 2.1 time: 0.214188 Aug 24 15:47:44.539180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 62/133] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:44 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:45.268623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:45.269242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:45.275931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.276610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.277378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.278455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.278919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.279349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.337627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:45.339274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:45.389190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.396145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.396715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.399016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.401132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.402647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.475904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:45.487500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:45.489070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:45.490207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-05a09ca8-f13f-41b6-8fd2-06f085379720 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.226125 Aug 24 15:47:45.490768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 72/134] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:45.528733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:45.531090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:45.548656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.549832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.550279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.551014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.552145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.553083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.753048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:45.761539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1aa38dec-52fd-4157-ae2a-6a69cdcb580d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.435371 Aug 24 15:47:45.762805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 63/135] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:45 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:45.767981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:45.768805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:45.775876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.776649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.777081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.777771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.778398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.778795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.857493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:45.868653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-072ef19e-0c48-4208-b392-2b1d8eb63d46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.351182 Aug 24 15:47:45.869624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 73/136] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:45 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:45.885943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-67597cf1-c2e7-4dd1-a0fe-45d5fc19179d req-6ab1da55-be70-4628-8295-9c8c96bed3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "name": "network-vif-plugged", "status": "completed", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:45.905474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-67597cf1-c2e7-4dd1-a0fe-45d5fc19179d req-6ab1da55-be70-4628-8295-9c8c96bed3de service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:45.906214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-67597cf1-c2e7-4dd1-a0fe-45d5fc19179d req-6ab1da55-be70-4628-8295-9c8c96bed3de service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:45.906790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-67597cf1-c2e7-4dd1-a0fe-45d5fc19179d req-6ab1da55-be70-4628-8295-9c8c96bed3de service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:45.924802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-67597cf1-c2e7-4dd1-a0fe-45d5fc19179d req-6ab1da55-be70-4628-8295-9c8c96bed3de service nova] Creating event network-vif-plugged:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 15:47:45.932235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-67597cf1-c2e7-4dd1-a0fe-45d5fc19179d req-6ab1da55-be70-4628-8295-9c8c96bed3de service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060862 Aug 24 15:47:45.933522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 74/137] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:46.033585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:46.041983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-166ab5a3-b12d-4c6c-ad23-2865f5d8c746 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1507 microversion: 2.1 time: 0.277853 Aug 24 15:47:46.042559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 64/138] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:45 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:46.518425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:46.519126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:46.526943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:46.527590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:46.528734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:46.529607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:46.530211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:46.530827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:46.783559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:46.784297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:46.804377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:46.806895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:46.807512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:46.808411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:46.810281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:46.810708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:46.964689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:46.973680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:46.975363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:46.979581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc36dd6d-77d3-48d6-a1d3-9c2f33d8bb3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.464923 Aug 24 15:47:46.980394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 75/139] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:46.987322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:46.987968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:46.996158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:46.996653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:46.997585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:46.999057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:47.000015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:47.000770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:47.004258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:47.129023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:47.155259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cef95b55-15dc-40f2-91c3-a3d4fb7010e5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.375227 Aug 24 15:47:47.156257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 65/140] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:46 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:47.232095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:47.240731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fd71180e-870f-4f37-b57f-b499533569d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.259501 Aug 24 15:47:47.241323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 76/141] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:46 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:48.010310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:48.010918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:48.017069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:48.017555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:48.017982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:48.018672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:48.019120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:48.019538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:48.178395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:48.180117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:48.188129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:48.189222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:48.189790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:48.190557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:48.191310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:48.191917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:48.219549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:48.237933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:48.239793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:48.241412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d0070fca-3f08-493d-be9c-ca7ec965d25a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.235649 Aug 24 15:47:48.243196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 66/142] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:48.263576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:48.267126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:48.274277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:48.275007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:48.275538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:48.276424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:48.276873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:48.277427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:48.511783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:48.523209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-87c3bc0b-5a78-42b8-8396-68f032dcd41b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.348212 Aug 24 15:47:48.536935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 77/143] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:48 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:48.562478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:48.570992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e31d3da-8539-4f0f-be9e-f731a94244c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.312646 Aug 24 15:47:48.582977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 67/144] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:48 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:49.267788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:49.268414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:49.275947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.276440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.276911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.277741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.278194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.278767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.447017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:49.457713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:49.460331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:49.463296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fb86b9db-d25d-4605-92cb-1cd8bfb4f81a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.200506 Aug 24 15:47:49.464423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 78/145] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:49.545052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:49.545883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:49.553735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.554234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.555396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.556404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.557082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.557733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.591374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:49.592141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:49.605949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.606736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.607239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.608010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.608728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.609351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.807385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:49.823771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-edafaa8a-1984-4479-8fcc-3bbedd1c89f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.282548 Aug 24 15:47:49.835312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:49.837702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 68/146] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:49 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:49.846279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1781535b-d729-46c7-9da6-75c3b32d42a1"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:49.846598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e141fb35-b7ee-4b4d-a4d8-b7d3fc4f5dd8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.259115 Aug 24 15:47:49.850290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:49.850447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 79/147] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:49 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:49.862829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.863661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.864227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.864845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.865275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.865704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:50.006426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:50.488801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:50.489552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:50.496335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:50.496829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:50.497262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:50.497955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:50.498451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:50.498898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:50.649690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:50.658464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:50.660038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:50.661165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9c2f19f5-0270-411d-aea2-f0ef6bf7dc95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.176222 Aug 24 15:47:50.661708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 80/148] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:50.667177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-448839881", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "networks": [{"uuid": "6f6880b5-588c-4e20-ae6a-d5582457562d"}]}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:50.723285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] validate_networks() for [('6f6880b5-588c-4e20-ae6a-d5582457562d', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:47:51.145750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:51.146108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:51.146584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:51.147346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:51.148680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:51.158893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.159551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.160014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.160737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.161187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.161611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.180432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Getting quotas for project 26e324399ad64863a994246cc04a4751. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:51.184600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Getting quotas for user 1e34111a3b2f4c1fb75252c4806d3da4 and project 26e324399ad64863a994246cc04a4751. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:51.200010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:51.202683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:51.262392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-56820f29-5918-4288-8a80-82fb691fc7f3 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.599335 Aug 24 15:47:51.263042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 81/149] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:47:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:47:51.268058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-4a8f837f-6662-496b-9b56-07799d392f53 req-672dba62-c2c4-43cc-b9f1-aa7a6a04b164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f1a7c0-a412-40d4-9809-6cbc75cae9a2", "name": "network-vif-plugged", "status": "completed", "tag": "509dd32c-8be1-4c88-a113-55950e314a5a"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:51.282921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-4a8f837f-6662-496b-9b56-07799d392f53 req-672dba62-c2c4-43cc-b9f1-aa7a6a04b164 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.283584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-4a8f837f-6662-496b-9b56-07799d392f53 req-672dba62-c2c4-43cc-b9f1-aa7a6a04b164 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.284049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-4a8f837f-6662-496b-9b56-07799d392f53 req-672dba62-c2c4-43cc-b9f1-aa7a6a04b164 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.296254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-4a8f837f-6662-496b-9b56-07799d392f53 req-672dba62-c2c4-43cc-b9f1-aa7a6a04b164 service nova] Creating event network-vif-plugged:509dd32c-8be1-4c88-a113-55950e314a5a for instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 on hv-cinder-84932 Aug 24 15:47:51.302042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-4a8f837f-6662-496b-9b56-07799d392f53 req-672dba62-c2c4-43cc-b9f1-aa7a6a04b164 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037352 Aug 24 15:47:51.302645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 82/150] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:51.309619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:51.310967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:51.313908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:51.320720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.321280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.321721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.322432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.322890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.323316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.476148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.485581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86f9a2d5-67cf-4a9c-8ad7-9b81bb929209 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.181523 Aug 24 15:47:51.486188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 83/151] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:51 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:51.490598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:51.491398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:51.509933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.510548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.511052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.511862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.512383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.512870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.667134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.675006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-640846af-b6b1-4d42-939e-c0ce6c3dbe88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.187805 Aug 24 15:47:51.676189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 84/152] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:51 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:51.692334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b1854896-9ee7-4268-83d9-e1400c30f25e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:51.693957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b1854896-9ee7-4268-83d9-e1400c30f25e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:51.779832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b1854896-9ee7-4268-83d9-e1400c30f25e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.787835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b1854896-9ee7-4268-83d9-e1400c30f25e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1217 microversion: 2.1 time: 0.109840 Aug 24 15:47:51.788429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 85/153] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:51 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:51.804822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:51.805438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:51.812072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.812886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.813419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.814352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.814897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.815580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.952800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.962591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.965227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.966364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5c13f006-9d54-460f-9fdb-7abce244474a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.176095 Aug 24 15:47:51.966919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 86/154] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:52.518159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:52.518159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:52.518159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.518159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.518886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.518886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.518886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.518886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.654206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:52.661846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-053cfe9d-3644-460c-a063-c061c3a7f990 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.156509 Aug 24 15:47:52.662740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 87/155] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:52 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:52.700311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:52.700920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:52.706859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.707339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.707800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.708485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.708937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.709354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.852116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:52.859826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aaac8c7f-1bf4-4283-8e4a-a4272e5c7d30 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.163266 Aug 24 15:47:52.860396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 88/156] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:52 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:52.864768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:52.865374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:52.871505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.872054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.872493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.873184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.873639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.874240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.937115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:52.944911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3b922bd6-f586-4bc9-9e53-d84d77754f90 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1221 microversion: 2.1 time: 0.083558 Aug 24 15:47:52.946066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 89/157] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:52 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:52.990113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:52.990711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:52.996686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.997200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.997630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.998318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.998765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.999180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:53.137420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:53.146146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:53.147677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:53.150142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bba1fa94-a4cd-4bb0-b71c-9cd3950c4ffd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.164047 Aug 24 15:47:53.150869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 90/158] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:53.684322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:53.684953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:53.690824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:53.691312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:53.691782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:53.692469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:53.693209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:53.693638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:53.823151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:53.830863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1f1d44a4-db93-4c5e-b71a-4352730eb8d9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.151072 Aug 24 15:47:53.831431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 91/159] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:53 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:53.880482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:53.881088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:53.887221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:53.887738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:53.888175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:53.888862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:53.889323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:53.889744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.045669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:54.053245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-319d644d-8599-42cb-9364-058eaa9d00ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1326 microversion: 2.1 time: 0.176542 Aug 24 15:47:54.053809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 92/160] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:53 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:54.058443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:54.059049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:54.064751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:54.065237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:54.065673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.066366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:54.066818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:54.067240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.134717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:54.142282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5ba9d256-a460-464b-98cb-8fb19f180223 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1221 microversion: 2.1 time: 0.087482 Aug 24 15:47:54.142852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 93/161] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:54 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:54.171144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:54.171775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:54.177749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:54.178231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:54.178662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.179362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:54.179897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:54.180317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.315455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:54.324571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:54.326073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:54.327171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7c254290-78f9-4403-8326-89bc501cc0ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.159690 Aug 24 15:47:54.327859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 94/162] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:54.855111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:54.856183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:54.862304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:54.862915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:54.863562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.864403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:54.864941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:54.866338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:54.875055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:55.076182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.092534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4f4993df-5f95-4060-835b-81bf1cfbc6ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.243697 Aug 24 15:47:55.106628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 95/163] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:54 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:55.112562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:55.113177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.117953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4c8e993c-e1b1-40b3-abb5-626bd769603e tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "POST /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.278890 Aug 24 15:47:55.118666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 69/164] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:47:49 2022] POST /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088/os-volume_attachments => generated 194 bytes in 5280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:55.124638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.125138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.125614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.126265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.126724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.127157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.165783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:55.166483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.172727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.173226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.173655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.174351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.174802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.175218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.253605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.261459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0916ea01-e763-4fe4-8e4e-6287faf5a2a1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1213 microversion: 2.1 time: 0.100957 Aug 24 15:47:55.262035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 70/165] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:55 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:55.296069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.308050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3e0cbb1-ae18-4c9e-a441-2fc5850e522e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1521 microversion: 2.1 time: 0.199713 Aug 24 15:47:55.308658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 96/166] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:55 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:55.329617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:55.331893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.338077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.338563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.338996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.339700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.340146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.340567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.349571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:55.350182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.357717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.358163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.358611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.359312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.359860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.360250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.366565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lazy-loading 'flavor' on Instance uuid 253aedec-4338-4cde-8059-862a76ca4202 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:47:55.494050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-de314f16-edf4-493a-ad92-96e90810fb33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202/action" status: 200 len: 32 microversion: 2.1 time: 0.168267 Aug 24 15:47:55.494667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 71/167] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:47:55 2022] POST /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:47:55.504908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:55.505597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.513800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.514287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.514718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.515406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.515886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.516299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.526885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.535702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.537896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.541147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-136fd04e-b386-4463-9d7c-658730e0bef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.195527 Aug 24 15:47:55.542954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 97/168] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:55.674076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:55.682456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dcb71b36-90d5-4cf8-81a8-6fda710e94cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.181916 Aug 24 15:47:55.697676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 72/169] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:55 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:56.114896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:56.115517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:56.123105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.123916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.124358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.125054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.125511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.125935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.275860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:56.283923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b76731d3-e6b9-4837-922f-18ab95028a55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.173666 Aug 24 15:47:56.284485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:56.284995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 98/170] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:56 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:56.285090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:56.293112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.293598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.294032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.294747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.295193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.295607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.361395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:56.369893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e6f7b20-502e-4b2c-b6d8-f087c5d3fae2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1213 microversion: 2.1 time: 0.091230 Aug 24 15:47:56.370619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 73/171] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:56 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:56.566392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:56.566992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:56.574239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.574719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.575145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.575858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.576307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.576725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.706200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:56.706200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:56.710369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:56.713983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.714478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.715157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.715894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.716512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.716958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.721132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:56.722744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:56.723877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-55d96ac8-8637-4e01-9848-69b053afdeec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1409 microversion: 2.20 time: 0.161391 Aug 24 15:47:56.724430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 99/172] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:56.878920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:56.889443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a45c09c1-1bf4-4a5d-bf9d-0a954b705291 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.188004 Aug 24 15:47:56.890254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 74/173] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:56 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:57.306542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:57.307145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:57.313530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.314023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.314465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.315163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.315617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.316075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.390576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:57.391317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:57.394333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=78 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:57.402946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.403454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.403927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.404789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.405416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.405848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.498988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:57.506507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-adfddbaa-8c73-430b-85b3-2494af0325ec tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1269 microversion: 2.1 time: 0.119956 Aug 24 15:47:57.507082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 75/174] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:57 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:57.520988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:57.529098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0dd6d95d-a7ac-426a-ae72-cae49d02c4b0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.227039 Aug 24 15:47:57.529657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 100/175] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:57 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:57.747950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:57.748529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:57.754641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.755284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.755747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.756444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.757191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.757793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.892103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:57.901069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:57.902600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:57.903778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9212747e-5bd1-4cf2-9f95-06106c7b019b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1601 microversion: 2.20 time: 0.159868 Aug 24 15:47:57.904332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 76/176] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:47:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:57.921731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:57.922380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:57.928345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:57.928504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.928841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:57.928987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.929449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.930290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.930763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.931182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.935028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.935514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.935983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:57.936675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:57.937125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:57.937543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:58.050759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-289ef1c9-0c32-4488-bbef-0e0a886b1f87 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.126162 Aug 24 15:47:58.051351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 77/177] 10.222.0.102 () {60 vars in 1321 bytes} [Wed Aug 24 15:47:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:47:58.104658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:58.112687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86b6a32f-6cda-4390-8faa-20bbf9a7504e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.197220 Aug 24 15:47:58.113266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 101/178] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:57 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:58.531895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:58.533122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:58.539888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:58.540880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:58.541332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:58.542311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:58.543039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:58.543466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:58.551291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:58.551866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:58.570671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:58.571505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:58.572546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:58.573438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:58.573899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:58.574611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:58.652506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:58.661843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-20faf5ad-9319-4e43-96c5-0bcbda8bbad2 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1269 microversion: 2.1 time: 0.138392 Aug 24 15:47:58.672945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 78/179] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:58 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:58.749481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:58.770794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9dc32a15-390c-4f02-a2c9-42c36711164d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.224370 Aug 24 15:47:58.771380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 102/180] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:58 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:59.134234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:59.134851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:59.141057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.141545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.141979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.142670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.143114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.143535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.280464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:59.288157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ae4c9c05-bddf-4368-9dc8-3bfc2ca1536a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.158002 Aug 24 15:47:59.288795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 79/181] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:59 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:59.382287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-f1766bff-3023-421d-a86d-7a0c1f96d82c req-2de2baab-a3bc-44cc-b723-eaa0dc0ce2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:59.392004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f1766bff-3023-421d-a86d-7a0c1f96d82c req-2de2baab-a3bc-44cc-b723-eaa0dc0ce2f3 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.392416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f1766bff-3023-421d-a86d-7a0c1f96d82c req-2de2baab-a3bc-44cc-b723-eaa0dc0ce2f3 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.392857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f1766bff-3023-421d-a86d-7a0c1f96d82c req-2de2baab-a3bc-44cc-b723-eaa0dc0ce2f3 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.404959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-f1766bff-3023-421d-a86d-7a0c1f96d82c req-2de2baab-a3bc-44cc-b723-eaa0dc0ce2f3 service nova] Creating event network-changed:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 15:47:59.413426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-f1766bff-3023-421d-a86d-7a0c1f96d82c req-2de2baab-a3bc-44cc-b723-eaa0dc0ce2f3 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034774 Aug 24 15:47:59.415150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 103/182] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:59.684735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:59.685294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:59.691883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.692372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.692838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.693761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.694214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.694632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.756291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:59.764569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b9869ba-d242-4370-a7c0-f18a6b84ee62 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1269 microversion: 2.1 time: 0.083693 Aug 24 15:47:59.765149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 80/183] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:59 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:59.792897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:59.793881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:59.801075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.801728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.802755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.803026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:59.803481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:59.804120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:59.966069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:59.973829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-68b23d71-0b12-4db2-aae0-33fa7af19b91 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.185926 Aug 24 15:47:59.974492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 104/184] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:47:59 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:00.309855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:00.310468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:00.316557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:00.317043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:00.317485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:00.318430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:00.319064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:00.319488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:00.458717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:00.467327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-789105e5-ee35-4f4e-bf6a-654cdc07b0ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.161248 Aug 24 15:48:00.469494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 81/185] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:00 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:00.786505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:00.787014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:00.793201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:00.793840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:00.794100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:00.794786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:00.795231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:00.795676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:00.858368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:00.866432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f2f4cfa6-7417-42e9-bd0c-1baab3799bc1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1269 microversion: 2.1 time: 0.083798 Aug 24 15:48:00.867102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 105/186] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:00 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:00.994997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:00.995601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:01.002077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:01.002556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:01.002983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:01.003704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:01.004156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:01.004574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:01.150338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:01.162822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f1f6226f-b5da-475b-bbf0-f6da38a99ead tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1368 microversion: 2.1 time: 0.171684 Aug 24 15:48:01.163718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 82/187] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:00 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:01.488468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:01.489087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:01.491020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:01.497227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:01.497717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:01.498150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:01.498844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:01.499322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:01.499754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:01.655137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:01.663524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7ba5f6cd-90c6-4013-b2cc-6d7063192753 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.178845 Aug 24 15:48:01.664165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 106/188] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:01 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:01.886329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:01.886930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:01.893069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:01.893530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:01.893899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:01.894585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:01.895038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:01.895461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:01.909839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:01.961236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:01.969121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e8d1f1bc-a808-4591-ae90-de24c7674f47 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1269 microversion: 2.1 time: 0.086632 Aug 24 15:48:01.970025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 83/189] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:01 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:02.184338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:02.184991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:02.186837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=8 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:02.192763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:02.193498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:02.193929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:02.194634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:02.195252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:02.195679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:02.340794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:02.348772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4bfb0629-c62c-4678-ad30-6cbf6f4cf77f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1554 microversion: 2.1 time: 0.168248 Aug 24 15:48:02.349351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 107/190] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:02 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:02.372482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:02.373751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:02.380562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:02.381327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:02.382003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:02.383126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:02.383852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:02.384283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:02.469333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0d5cb7ed-ec25-467d-a812-4840fbd55ccd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101283 Aug 24 15:48:02.469920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 84/191] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 15:48:02 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:02.685611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:02.687326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:02.696363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:02.697210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:02.697799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:02.698622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:02.699293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:02.699835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:02.888861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:02.896933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-97041cc5-5410-4d0d-b4e4-dd1f7dc0bdb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.215160 Aug 24 15:48:02.897511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 108/192] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:02 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:02.990693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:02.991320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:03.000266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:03.001054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:03.001704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:03.002626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:03.003260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:03.003724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:03.103373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:03.118946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6d1e778f-7fd0-41dc-9dc1-fa6dd5a5ad81 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1269 microversion: 2.1 time: 0.131949 Aug 24 15:48:03.120405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 85/193] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:02 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:03.926229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:03.927601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:03.936861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:03.937622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:03.938284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:03.939372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:03.940061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:03.941356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:04.143608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:04.144880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:04.155802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:04.156875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:04.157748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:04.158823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:04.159434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:04.160038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:04.166479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:04.178822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7079392f-1cf5-45c3-a1e5-0d8a8c0f6f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.256849 Aug 24 15:48:04.195466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 109/194] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:03 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:04.252363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:04.260592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b2efe6f-e1f3-4d8d-84ad-67619c870a0f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1275 microversion: 2.1 time: 0.122699 Aug 24 15:48:04.261106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 86/195] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:04 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:04.624137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-1ea20ca3-07f9-454d-9ba9-045a089a991d req-a7e97b37-f03a-49e3-9065-c59fb099f859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f1a7c0-a412-40d4-9809-6cbc75cae9a2", "tag": "509dd32c-8be1-4c88-a113-55950e314a5a"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:04.641778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-1ea20ca3-07f9-454d-9ba9-045a089a991d req-a7e97b37-f03a-49e3-9065-c59fb099f859 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:04.652631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-1ea20ca3-07f9-454d-9ba9-045a089a991d req-a7e97b37-f03a-49e3-9065-c59fb099f859 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:04.662784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-1ea20ca3-07f9-454d-9ba9-045a089a991d req-a7e97b37-f03a-49e3-9065-c59fb099f859 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:04.686646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-1ea20ca3-07f9-454d-9ba9-045a089a991d req-a7e97b37-f03a-49e3-9065-c59fb099f859 service nova] Creating event network-changed:509dd32c-8be1-4c88-a113-55950e314a5a for instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 on hv-cinder-84932 Aug 24 15:48:04.693956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-1ea20ca3-07f9-454d-9ba9-045a089a991d req-a7e97b37-f03a-49e3-9065-c59fb099f859 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073017 Aug 24 15:48:04.698179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 110/196] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:05.206803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:05.209099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:05.218652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:05.219141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:05.219573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:05.220303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:05.220754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:05.221175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:05.282596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:05.283304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:05.298433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:05.298924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:05.299358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:05.307765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:05.308412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:05.308851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:05.745863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:05.756477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:05.759473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-77e5fa34-0e4e-4e4d-84e8-ad5d4c290892 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.560785 Aug 24 15:48:05.760162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 87/197] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:05 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:05.771293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-62112b1a-c27b-487e-9435-078275d5664a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.486757 Aug 24 15:48:05.771990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 111/198] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:05 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:06.781135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:06.781748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:06.794465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.795082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.795501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.796558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.796677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:06.798835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.799034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:06.799860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.806036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.806748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.807366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.808105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.808777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.809779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:07.008708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:07.017666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cabd0350-9f2c-474c-a9a3-af7663829cfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.240633 Aug 24 15:48:07.018721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 88/199] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:06 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:07.072724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:07.081931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e410d783-22fa-483a-b359-c62cdbfb59fe tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.293031 Aug 24 15:48:07.082879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 112/200] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:06 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:08.040879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:08.042026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:08.049945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.050671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.051325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.052311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.053099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.053999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.106883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:08.108226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:08.115192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.116214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.117636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.118597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.119814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.120529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.128293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:08.332157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:08.350052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1a731699-cd1a-4b50-bb33-f44c1d656dce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.315387 Aug 24 15:48:08.350553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 89/201] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:08 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:08.437630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:08.449729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-38390fda-99b9-492b-b940-275eff023ff1 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.346519 Aug 24 15:48:08.450683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 113/202] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:08 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:08.924153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-ba65bbe1-e7dc-4088-bdbf-3e39c2e71dfd req-7bded7f2-b19c-49f8-b09c-5bbed02dc8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8012095f-0cdb-4e06-81d4-3fe7af765f45", "tag": "bdbf892f-c247-4b36-b369-f33dd9b30f75"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:08.934657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ba65bbe1-e7dc-4088-bdbf-3e39c2e71dfd req-7bded7f2-b19c-49f8-b09c-5bbed02dc8ca service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.935138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ba65bbe1-e7dc-4088-bdbf-3e39c2e71dfd req-7bded7f2-b19c-49f8-b09c-5bbed02dc8ca service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.935572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ba65bbe1-e7dc-4088-bdbf-3e39c2e71dfd req-7bded7f2-b19c-49f8-b09c-5bbed02dc8ca service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.947961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-ba65bbe1-e7dc-4088-bdbf-3e39c2e71dfd req-7bded7f2-b19c-49f8-b09c-5bbed02dc8ca service nova] Creating event network-changed:bdbf892f-c247-4b36-b369-f33dd9b30f75 for instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 on hv-cinder-84932 Aug 24 15:48:08.954862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-ba65bbe1-e7dc-4088-bdbf-3e39c2e71dfd req-7bded7f2-b19c-49f8-b09c-5bbed02dc8ca service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033590 Aug 24 15:48:08.956585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 90/203] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:09.373856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:09.374469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:09.380591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:09.381074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:09.381504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:09.382231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:09.382710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:09.383133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:09.475768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:09.477312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:09.484904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:09.485645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:09.486216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:09.487177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:09.487747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:09.488272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:09.552928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:09.565861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9622dc10-dc29-49f9-a594-78ff4717b8c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.194865 Aug 24 15:48:09.567467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 114/204] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:09 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:09.656069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:09.664817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ffa6434c-253c-40b3-af87-342d64b252bc tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.193587 Aug 24 15:48:09.665451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 91/205] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:09 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:10.591255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:10.592449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:10.613151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:10.614024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:10.614955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:10.616146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:10.617627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:10.618586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:10.686238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:10.686852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:10.693277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:10.694015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:10.694509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:10.695737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:10.696189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:10.696609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:10.862409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:10.873439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-821bc8b3-d7af-4e8c-ab5b-764e41272e6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.289114 Aug 24 15:48:10.879463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 115/206] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:10 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:10.927202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:10.938000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2d7e1324-7111-46b2-b77b-fd3b71034f53 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.255502 Aug 24 15:48:10.938671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 92/207] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:10 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:11.431665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:11.432089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:11.438488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.439040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.439482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.440224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.440691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.441118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.473630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:48:11.626724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6eb1be4-07e7-4f5f-bcda-5a5f853e33c4 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "DELETE /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 204 len: 0 microversion: 2.1 time: 0.199928 Aug 24 15:48:11.627817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 116/208] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:48:11 2022] DELETE /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:48:11.636280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:11.636992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:11.642849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.643346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.645652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.646369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.646825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.647249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.807885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:11.817038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6ee45435-ddc8-4741-8bd9-a5a4f00f0282 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1559 microversion: 2.1 time: 0.185036 Aug 24 15:48:11.817706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 93/209] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:11 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:11.904303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:11.905340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:11.911390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.912122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.912608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.913474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.914151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.915128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.962339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:11.962969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:11.977032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.977528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.980215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.980952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.981415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.981837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:12.157673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:12.170633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aa742bb8-2f76-4f93-bd4d-5d6d4ba1af35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.271093 Aug 24 15:48:12.172969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 117/210] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:11 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:12.236514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:12.244285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f3219308-0ea1-4747-b8d7-569b59c00469 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.286634 Aug 24 15:48:12.244845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 94/211] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:11 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:12.840278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:12.840960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:12.851834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:12.852674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:12.853327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:12.858314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:12.858803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:12.859235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.069635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:13.091003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-205d3b0b-30cb-42c7-924b-50c7b0b4314a tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1559 microversion: 2.1 time: 0.254967 Aug 24 15:48:13.091735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 118/212] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:12 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1559 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:13.222067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:13.240260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:13.265820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:13.267292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:13.270946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.272251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:13.273173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:13.273873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:13.275873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:13.276824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.281841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:13.282624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:13.283290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.284479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:13.285219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:13.286062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.614694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:13.633856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b2bb5b30-8579-420e-bfee-f86c6b2a810f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.368157 Aug 24 15:48:13.634394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 119/213] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:13 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:13.709853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:13.724661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-62e5ca0c-e55c-45d1-ab1a-7c4509f25885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.533859 Aug 24 15:48:13.725618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 95/214] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:13 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:14.118260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:14.119339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:14.127293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.128191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.129136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.130194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.130804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.131837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.323049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:14.332176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-78f3ffc3-d925-4a0b-b17e-26d8a6d8da89 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1559 microversion: 2.1 time: 0.219680 Aug 24 15:48:14.332791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 120/215] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:14 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:14.658445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:14.659302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:14.666572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.667245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.667880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.669043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.669631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.670197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.749012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:14.750198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:14.758143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.758982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.759607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.770295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.770880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.771340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.891413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:14.905186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d5652cfe-8000-422a-97f3-77fd705e91cd tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.250329 Aug 24 15:48:14.921287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 96/216] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:14 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:15.015837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:15.034452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-49008bc5-4595-493f-9463-39b1c7a5cebd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.288934 Aug 24 15:48:15.035057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 121/217] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:14 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:15.067362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-2576a0f2-30aa-4451-8a1f-1aed93b2e5bd req-bf21d7ed-fb43-4ddc-9367-94034b5cd6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8012095f-0cdb-4e06-81d4-3fe7af765f45", "name": "network-vif-plugged", "status": "completed", "tag": "bdbf892f-c247-4b36-b369-f33dd9b30f75"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:15.082524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2576a0f2-30aa-4451-8a1f-1aed93b2e5bd req-bf21d7ed-fb43-4ddc-9367-94034b5cd6d7 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.086565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2576a0f2-30aa-4451-8a1f-1aed93b2e5bd req-bf21d7ed-fb43-4ddc-9367-94034b5cd6d7 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.088417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2576a0f2-30aa-4451-8a1f-1aed93b2e5bd req-bf21d7ed-fb43-4ddc-9367-94034b5cd6d7 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:15.118358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-2576a0f2-30aa-4451-8a1f-1aed93b2e5bd req-bf21d7ed-fb43-4ddc-9367-94034b5cd6d7 service nova] Creating event network-vif-plugged:bdbf892f-c247-4b36-b369-f33dd9b30f75 for instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 on hv-cinder-84932 Aug 24 15:48:15.136435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-2576a0f2-30aa-4451-8a1f-1aed93b2e5bd req-bf21d7ed-fb43-4ddc-9367-94034b5cd6d7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072998 Aug 24 15:48:15.145302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 97/218] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:15.359434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:15.360766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:15.369550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.370488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.371072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:15.372085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.372846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.373705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:15.591084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:15.600537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cf25d467-6378-4793-b6c3-95d59c3b1159 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1559 microversion: 2.1 time: 0.246191 Aug 24 15:48:15.601143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 122/219] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:15 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1559 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:15.933712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:15.937513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:15.952723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.953536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.954129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:15.954849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.955498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.956107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.057827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:16.058594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:16.068072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.069489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.070754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.071787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.072745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.073384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.322797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:16.331377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-efc89225-4082-4c92-b21c-e0597da6e217 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1317 microversion: 2.1 time: 0.405635 Aug 24 15:48:16.332406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 98/220] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:15 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:16.339974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-2512db16-89b0-45a4-be88-495fd701656c req-541b8d13-25ee-401f-9952-b0b356e31ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0993cf-1281-4dd9-a365-c3f602300088", "name": "network-vif-deleted", "tag": "56b38b5a-983e-4b27-b9a7-54fe664029a0"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:16.353124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2512db16-89b0-45a4-be88-495fd701656c req-541b8d13-25ee-401f-9952-b0b356e31ec1 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.353850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2512db16-89b0-45a4-be88-495fd701656c req-541b8d13-25ee-401f-9952-b0b356e31ec1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.354436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2512db16-89b0-45a4-be88-495fd701656c req-541b8d13-25ee-401f-9952-b0b356e31ec1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.386665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-2512db16-89b0-45a4-be88-495fd701656c req-541b8d13-25ee-401f-9952-b0b356e31ec1 service nova] Creating event network-vif-deleted:56b38b5a-983e-4b27-b9a7-54fe664029a0 for instance 9c0993cf-1281-4dd9-a365-c3f602300088 on hv-cinder-84932 Aug 24 15:48:16.394310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-2512db16-89b0-45a4-be88-495fd701656c req-541b8d13-25ee-401f-9952-b0b356e31ec1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060540 Aug 24 15:48:16.394579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:16.395711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 99/221] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:16.403586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-72c999d5-f944-4230-8bcc-5b79ce2e8bbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.350599 Aug 24 15:48:16.404184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 123/222] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:16 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:16.623986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:16.624815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:16.656214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.656731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.657171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.657892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.658345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.658767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.752786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:16.762155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8325cec3-c5e1-4077-b16a-108fa20715ca tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1350 microversion: 2.1 time: 0.142935 Aug 24 15:48:16.767672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 100/223] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:16 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:17.355368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:17.356537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:17.363031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.363531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.364023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.364721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.365181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.365752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.435215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:17.436729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:17.444363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.445257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.446099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.447055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.447618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.448190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.574163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:17.583516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b024d0d1-6b19-473a-a32d-c5119a9475a6 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1502 microversion: 2.1 time: 0.233603 Aug 24 15:48:17.586392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 124/224] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:17 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:17.623841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:17.638399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3c960bad-41cc-4c07-929f-18bf54c5a858 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.216106 Aug 24 15:48:17.638996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 101/225] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:17 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:17.783576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:17.784459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:17.791482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.792214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.793485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.794202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.794659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.795093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.859370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.859909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.860347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.860809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lazy-loading 'fault' on Instance uuid 9c0993cf-1281-4dd9-a365-c3f602300088 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:48:17.949082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db03e18a7b24157a8ac724a615373f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b454a2613ce5453b81b0a78019eed614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:17.958772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fd8d2efa-e32b-478a-b276-3d1bb69f5260 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 200 len: 1355 microversion: 2.1 time: 0.178801 Aug 24 15:48:17.959914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 125/226] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:17 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 1355 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:18.173681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:18.174286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:18.181130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.181831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.182287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.182988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.183440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.183915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.200789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:18.212374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Going to try to terminate instance {{(pid=132518) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:48:18.315528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7185f493-fa53-4846-be22-9f9e1e58a79f tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "DELETE /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 204 len: 0 microversion: 2.1 time: 0.145405 Aug 24 15:48:18.319717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 102/227] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:48:18 2022] DELETE /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:48:18.326879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:18.327932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:18.336530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.337185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.337692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.338477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.339161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.339720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.493073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:18.501067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb92e597-fe2f-4629-a3c7-febb51f94d9e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1508 microversion: 2.1 time: 0.179244 Aug 24 15:48:18.501664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 126/228] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:18 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:18.661647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:18.662374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:18.668778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.669258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.669689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.670375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.670826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.671248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.802284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:18.810847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2e77a7d-51d2-48a2-8e05-1c06e2c84845 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.153402 Aug 24 15:48:18.811416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 103/229] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:18 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:18.983532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:18.984503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:18.991558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.992991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.993474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:18.994192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:18.994650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:18.995083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.009156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] HTTP exception thrown: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Request method failure captured: Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 HTTP/1.1 Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf0H26jHPtJkjFEe77s3sX54NDJOUED15VAlcBEPZrFNjGzrje0bYfHkEjCtxfwqvy0FlVUx_w1IRzo8M445b_A3HZnzL8JRzmFWRmJva1Aggasjk11dhjeQYpoT6dfXcZ7UQrXjUkbeznB5XPoldYVTMXDa7wdDt4Os7bH4RxZB3E Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:48:19.013785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b454a2613ce5453b81b0a78019eed614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 9db03e18a7b24157a8ac724a615373f4 Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.015348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '9c0993cf-1281-4dd9-a365-c3f602300088'} Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:19.016201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.017596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.018777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Returning 404 to user: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:19.018777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c2ee0cf2-ab1b-475f-b2e0-362a9657520b tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 404 len: 111 microversion: 2.1 time: 0.036922 Aug 24 15:48:19.018777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 127/230] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:18 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:19.143205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:19.145619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:19.152915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.153402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.153836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.155113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.155113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.155389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.168591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] HTTP exception thrown: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Request method failure captured: Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088/os-volume_attachments HTTP/1.1 Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf0H26jHPtJkjFEe77s3sX54NDJOUED15VAlcBEPZrFNjGzrje0bYfHkEjCtxfwqvy0FlVUx_w1IRzo8M445b_A3HZnzL8JRzmFWRmJva1Aggasjk11dhjeQYpoT6dfXcZ7UQrXjUkbeznB5XPoldYVTMXDa7wdDt4Os7bH4RxZB3E Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:48:19.172676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b454a2613ce5453b81b0a78019eed614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 9db03e18a7b24157a8ac724a615373f4 Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.174075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'server_id': '9c0993cf-1281-4dd9-a365-c3f602300088'} Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:19.174895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:19.176405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:19.177538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Returning 404 to user: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:19.177538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-afcf5afc-0615-41ae-8abb-ef0db00e1cd2 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035554 Aug 24 15:48:19.177538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 104/231] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:48:19 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:19.524730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:19.525509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:19.528852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:19.534849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.535349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.535822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.536533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.536988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.537451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.557574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:19.729580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:19.738871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3282b889-d458-4151-bdd5-cce599aa9854 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1508 microversion: 2.1 time: 0.218772 Aug 24 15:48:19.740066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 128/232] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:19 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:19.833004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:19.833870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:19.845115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.845781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.846583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.847283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.847902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.848628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.998601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:20.008796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bf785d71-d75d-4ab3-9f3a-16a39e5dd50a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.179035 Aug 24 15:48:20.009479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 105/233] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:19 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:20.395917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:20.398635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:20.403417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.403946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.404379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.405080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.405531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.405941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.422283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] HTTP exception thrown: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Request method failure captured: Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: DELETE /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 HTTP/1.1 Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf0H26jHPtJkjFEe77s3sX54NDJOUED15VAlcBEPZrFNjGzrje0bYfHkEjCtxfwqvy0FlVUx_w1IRzo8M445b_A3HZnzL8JRzmFWRmJva1Aggasjk11dhjeQYpoT6dfXcZ7UQrXjUkbeznB5XPoldYVTMXDa7wdDt4Os7bH4RxZB3E Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:48:20.424210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b454a2613ce5453b81b0a78019eed614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 9db03e18a7b24157a8ac724a615373f4 Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.425722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '9c0993cf-1281-4dd9-a365-c3f602300088'} Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:20.429782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.431258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.432465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Returning 404 to user: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:20.432465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f28ead0b-0f66-4cbb-83a2-9689ebbf8edc tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "DELETE /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 404 len: 111 microversion: 2.1 time: 0.034979 Aug 24 15:48:20.432465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 129/234] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:48:20 2022] DELETE /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:20.435940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:20.436767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] [instance: 9c0993cf-1281-4dd9-a365-c3f602300088] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:20.445107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.445599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.446187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.447053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.447876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.447973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.464418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] HTTP exception thrown: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Request method failure captured: Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 HTTP/1.1 Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf0H26jHPtJkjFEe77s3sX54NDJOUED15VAlcBEPZrFNjGzrje0bYfHkEjCtxfwqvy0FlVUx_w1IRzo8M445b_A3HZnzL8JRzmFWRmJva1Aggasjk11dhjeQYpoT6dfXcZ7UQrXjUkbeznB5XPoldYVTMXDa7wdDt4Os7bH4RxZB3E Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:48:20.467002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b454a2613ce5453b81b0a78019eed614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b454a2613ce5453b81b0a78019eed614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: b454a2613ce5453b81b0a78019eed614 Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-DeleteServersTestJSON-880157763 Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 9db03e18a7b24157a8ac724a615373f4 Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-DeleteServersTestJSON-880157763-project Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.468436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '9c0993cf-1281-4dd9-a365-c3f602300088'} Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:20.469216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. Aug 24 15:48:20.470461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:20.473239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] Returning 404 to user: Instance 9c0993cf-1281-4dd9-a365-c3f602300088 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:20.474095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-464051d9-9cb1-4981-8bef-cc939d8170d7 tempest-DeleteServersTestJSON-880157763 tempest-DeleteServersTestJSON-880157763-project] 10.222.0.102 "GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088" status: 404 len: 111 microversion: 2.1 time: 0.043206 Aug 24 15:48:20.475032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 106/235] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:20 2022] GET /compute/v2.1/servers/9c0993cf-1281-4dd9-a365-c3f602300088 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:20.760043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:20.760967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:20.767169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.768013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.768692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.769622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.770283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.771162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.901189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:20.913509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-da8572c2-f1ed-4573-8bbd-0a6c707bfc02 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 200 len: 1466 microversion: 2.1 time: 0.157464 Aug 24 15:48:20.915186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 130/236] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:20 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 1466 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:20.928044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-d5f72c46-a4ef-4605-a1c9-b6cf81a765a4 req-ad902ffb-f5e9-4a63-bb19-a1d971716716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8012095f-0cdb-4e06-81d4-3fe7af765f45", "name": "network-vif-deleted", "tag": "bdbf892f-c247-4b36-b369-f33dd9b30f75"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:20.934090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-d5f72c46-a4ef-4605-a1c9-b6cf81a765a4 req-ad902ffb-f5e9-4a63-bb19-a1d971716716 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.934580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-d5f72c46-a4ef-4605-a1c9-b6cf81a765a4 req-ad902ffb-f5e9-4a63-bb19-a1d971716716 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.935098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-d5f72c46-a4ef-4605-a1c9-b6cf81a765a4 req-ad902ffb-f5e9-4a63-bb19-a1d971716716 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.970764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-d5f72c46-a4ef-4605-a1c9-b6cf81a765a4 req-ad902ffb-f5e9-4a63-bb19-a1d971716716 service nova] Creating event network-vif-deleted:bdbf892f-c247-4b36-b369-f33dd9b30f75 for instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 on hv-cinder-84932 Aug 24 15:48:20.980984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-d5f72c46-a4ef-4605-a1c9-b6cf81a765a4 req-ad902ffb-f5e9-4a63-bb19-a1d971716716 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068711 Aug 24 15:48:20.995951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 107/237] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:21.034093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:21.034870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:21.044271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.044872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.045475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.046264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.046823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.047505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.535077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:21.548496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-05e32de4-73b9-4dfa-a869-3f546f88cdb1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.518559 Aug 24 15:48:21.552249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 131/238] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:21 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:21.940081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:21.941083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 8012095f-0cdb-4e06-81d4-3fe7af765f45] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:21.950060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.950687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.951309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.952062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.952673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.953159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.968016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] HTTP exception thrown: Instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 could not be found. Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Request method failure captured: Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 HTTP/1.1 Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkgkCmCcGFq1eRb3cz2s2Oea_oPNvTW6MVoqr6ntMQBLCXaMLfbIKM8aQVRpmov7w4jq0bPTB82Sf2Ui2fsJ6k7mVySntcfvBJW3q0DX05u038UBs_xpTvfLX1S2EohG6uYvrcsSOPtOgAOGLpPH8IamvUAz0Qpq1VhgvG0MmNhqxNs Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 26e324399ad64863a994246cc04a4751 Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesActionsTest-1270012904 Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:48:21.969856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/26e324399ad64863a994246cc04a4751"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/26e324399ad64863a994246cc04a4751"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_26e324399ad64863a994246cc04a4751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/26e324399ad64863a994246cc04a4751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesActionsTest-1270012904 Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 26e324399ad64863a994246cc04a4751 Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesActionsTest-1270012904 Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesActionsTest-1270012904-project Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 1e34111a3b2f4c1fb75252c4806d3da4 Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesActionsTest-1270012904-project Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 could not be found. Aug 24 15:48:21.971165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '8012095f-0cdb-4e06-81d4-3fe7af765f45'} Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 could not be found. Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:21.971870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 could not be found. Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 could not be found. Aug 24 15:48:21.972951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:21.973904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Returning 404 to user: Instance 8012095f-0cdb-4e06-81d4-3fe7af765f45 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:21.973904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-98bcc898-66df-4b97-8013-9784c4a17d8e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45" status: 404 len: 111 microversion: 2.1 time: 0.038756 Aug 24 15:48:21.977955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 108/239] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:21 2022] GET /compute/v2.1/servers/8012095f-0cdb-4e06-81d4-3fe7af765f45 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:22.114900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1551973008", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "networks": [{"uuid": "6f6880b5-588c-4e20-ae6a-d5582457562d"}]}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:22.178566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] validate_networks() for [('6f6880b5-588c-4e20-ae6a-d5582457562d', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:48:22.571873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:22.572863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:22.587008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:22.588284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:22.589463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:22.590570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:22.591284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:22.591962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:22.980813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:22.992844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-190b3198-6dd1-42ea-895f-20daaa02256a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.426443 Aug 24 15:48:22.993799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 109/240] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:22 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:23.126278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:48:23.127361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:48:23.127865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:48:23.128415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:48:23.129025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:48:23.140238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:23.140890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:23.141355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:23.142041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:23.142648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:23.143411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:23.161405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Getting quotas for project 26e324399ad64863a994246cc04a4751. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:23.165775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Getting quotas for user 1e34111a3b2f4c1fb75252c4806d3da4 and project 26e324399ad64863a994246cc04a4751. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:23.177056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:48:23.179995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:48:23.234833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-97b9c32b-a238-494b-9d4b-0d4ff2da2d4e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.123241 Aug 24 15:48:23.247151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-99efec45-3897-407b-9498-a29aadfb0a22 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:23.247801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-99efec45-3897-407b-9498-a29aadfb0a22 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:23.254345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 132/241] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:48:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:48:23.324152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-99efec45-3897-407b-9498-a29aadfb0a22 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:23.334388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-99efec45-3897-407b-9498-a29aadfb0a22 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1218 microversion: 2.1 time: 0.090748 Aug 24 15:48:23.348458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 110/242] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:23 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:24.019503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:24.020361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:24.048109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.048109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.048886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.051309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.054980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.056717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.357286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:24.357950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:24.358725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:24.364353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.364837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.365265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.365988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.366432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.367047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.368907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cb980740-33b5-452b-8dfb-9b31915da0a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.354950 Aug 24 15:48:24.369486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 133/243] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:24 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:24.446306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:24.454297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c89c8b92-a9c3-456a-b863-89c7ad4abda8 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1270 microversion: 2.1 time: 0.101001 Aug 24 15:48:24.454920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 111/244] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:24 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:25.394039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:25.395297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:25.410430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:25.411191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:25.411973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.412946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:25.414935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:25.415577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.478220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:25.479454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:25.497074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:25.497620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:25.498054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.498870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:25.504682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:25.509057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.724757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:25.735790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91d89242-bbaf-4ca9-a6d4-ba13f77e9c68 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1276 microversion: 2.1 time: 0.264010 Aug 24 15:48:25.736211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 112/245] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:25 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1276 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:25.846874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:25.859183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-09f30eec-1305-4e24-8512-7c0eea8cf067 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.472256 Aug 24 15:48:25.862227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 134/246] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:25 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:26.622112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-6203e3ff-8324-44be-b883-50a403e6e489 req-6da7b554-5046-4477-9257-c8b2db942550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b06734-16e2-427c-be4e-872cec28af4c", "tag": "2979a8b0-d8de-4535-959a-35f7f7b87915"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:26.640623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-6203e3ff-8324-44be-b883-50a403e6e489 req-6da7b554-5046-4477-9257-c8b2db942550 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.641270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-6203e3ff-8324-44be-b883-50a403e6e489 req-6da7b554-5046-4477-9257-c8b2db942550 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.641863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-6203e3ff-8324-44be-b883-50a403e6e489 req-6da7b554-5046-4477-9257-c8b2db942550 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:26.671005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-6203e3ff-8324-44be-b883-50a403e6e489 req-6da7b554-5046-4477-9257-c8b2db942550 service nova] Creating event network-changed:2979a8b0-d8de-4535-959a-35f7f7b87915 for instance 80b06734-16e2-427c-be4e-872cec28af4c on hv-cinder-84932 Aug 24 15:48:26.676225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-6203e3ff-8324-44be-b883-50a403e6e489 req-6da7b554-5046-4477-9257-c8b2db942550 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060619 Aug 24 15:48:26.677206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 113/247] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:26.759242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:26.760361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:26.771669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.772166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.772627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:26.773357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.774052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.774479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:26.887536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:26.888307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:26.901643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.909080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.909696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:26.910538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.911096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.914822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:27.094400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:27.107417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b4c8d037-d5ec-47a5-9f75-e442eb37e408 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.352939 Aug 24 15:48:27.108426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 135/248] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:26 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:27.185338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:27.202897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1661592b-8b45-4f84-afaa-6ba5ea647e0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.324202 Aug 24 15:48:27.203960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 114/249] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:26 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:28.128970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:28.130238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:28.136497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:28.137550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:28.137974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:28.140124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:28.140748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:28.141277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:28.225070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:28.226788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:28.233720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:28.235916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:28.236577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:28.237203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:28.238087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:28.238706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:28.239137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:28.314740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:28.324206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8485a530-1551-482b-bfa7-c8fd804b7321 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.199117 Aug 24 15:48:28.325002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 136/250] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:28 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:28.449144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:28.474304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0e6e2a13-83cb-496a-80e4-f030e587ca96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.253087 Aug 24 15:48:28.491902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 115/251] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:28 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:29.346098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:29.346710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:29.353513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:29.354009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:29.354656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:29.355548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:29.356038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:29.356466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:29.504806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:29.505418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:29.513280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:29.514076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:29.514735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:29.516068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:29.516758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:29.517401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:29.659350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:29.670870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e56a8e9-f228-40be-b51f-a7156e8f6b05 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.328609 Aug 24 15:48:29.685415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 137/252] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:29 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:29.746908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:29.761338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-76aec9ba-f288-4e06-a023-6c6ddec375dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.260113 Aug 24 15:48:29.762233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 116/253] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:29 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:30.692943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:30.694546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:30.705332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:30.706671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:30.708018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:30.709540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:30.710226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:30.711125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:30.782221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:30.784337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:30.801671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:30.802396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:30.803017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:30.803979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:30.805650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:30.806465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:31.391704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:31.424134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-96f93947-4dc8-4cbd-9516-73155a3c13cf tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.728404 Aug 24 15:48:31.426683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 138/254] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:30 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:31.431954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:31.444969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-423e0d01-03a2-48bb-b8f2-2e443860fb61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.666008 Aug 24 15:48:31.445994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 117/255] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:30 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:32.446760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:32.447344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:32.453734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.454232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.454672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.455372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.455855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.456273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.467227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:32.468606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:32.477278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.478169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.478874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.479744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.480311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.480879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.879271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:32.892333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-405eaeb2-396d-43ed-8c78-3891c6e022ed tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.428123 Aug 24 15:48:32.893911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 118/256] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:32 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:32.932000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:32.943344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f642bcd0-8a54-4104-9ded-da90d513f68e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.500360 Aug 24 15:48:32.948345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 139/257] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:32 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:33.394874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:33.511585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3782d31a-d782-45ab-84fe-57c1885856b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: .version_select at 0x7fc5cd2a1310>, body: {"keypair": {"name": "tempest-keypair-547664228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2eIAOq7/v9ti9nJzIfW+ypQiY+QMehw3vqPXWncJojiF5LCyUWftwYMHOSPfTyebtk14YaggEFa2Xgx5DJ81Zhrsvn+cE3LcLU7f8R5elBhgaBTn2ITcrY+4GDjrveLw=="}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:33.531067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-3782d31a-d782-45ab-84fe-57c1885856b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:33.534963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-3782d31a-d782-45ab-84fe-57c1885856b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:33.575122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3782d31a-d782-45ab-84fe-57c1885856b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184899 Aug 24 15:48:33.582210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 119/258] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 15:48:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:33.932217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:33.935342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:33.938385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:33.939234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:33.946973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:33.947471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:33.947924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:33.948846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:33.949304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:33.949729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:33.973673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:33.974571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:33.988600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:33.989416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:33.989906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:33.990889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:33.991346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:33.992579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.164315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:34.187688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eab7142d-7ca4-4a1a-8005-5ee9380f04d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.264553 Aug 24 15:48:34.192321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 140/259] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:33 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:34.197464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:34.208230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dbe2130a-56de-4429-add1-02423acc92d0 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.243355 Aug 24 15:48:34.208868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 120/260] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:33 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:35.067315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-462368522", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "865ac09d-5307-48a3-bc8a-ec402499204e"}], "security_groups": [{"name": "tempest-securitygroup--355417277"}], "key_name": "tempest-keypair-547664228", "user_data": "}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:35.198299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] validate_networks() for [('865ac09d-5307-48a3-bc8a-ec402499204e', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:48:35.215059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:35.216289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:35.232422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.235859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.237238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.239416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.240764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.242071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.612394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:35.626006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d475d95b-257c-4e89-a5ed-c0d6683317fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.415498 Aug 24 15:48:35.629142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 121/261] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:35 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:35.636135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:35.637046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:35.656502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.658282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.658929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.660049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.660708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.662069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.890758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:48:35.891382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:48:35.892000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:48:35.892516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:48:35.893040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:48:35.922504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.923325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.924082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.925025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.925684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.926113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.946758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:35.947529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:35.951072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:35.960054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:35.968373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b69b8571-acda-4328-b2ff-87dd5a760583 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.329594 Aug 24 15:48:35.969990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 122/262] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:35 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:35.982528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:48:35.985075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:48:36.062098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e5cc74be-b467-4739-9325-25a53fc255a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.001777 Aug 24 15:48:36.063227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 141/263] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:48:35 2022] POST /compute/v2.1/servers => generated 403 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:48:36.078676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2d55fddf-3e4e-4a08-b702-9f58295d8fd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:36.079931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2d55fddf-3e4e-4a08-b702-9f58295d8fd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:36.149969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2d55fddf-3e4e-4a08-b702-9f58295d8fd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:36.157102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2d55fddf-3e4e-4a08-b702-9f58295d8fd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1244 microversion: 2.1 time: 0.084133 Aug 24 15:48:36.158366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 123/264] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:36.650700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:36.651319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:36.668417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:36.669143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:36.669451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:36.670261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:36.670721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:36.671344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:36.949704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:36.958263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee89dfe8-78e8-4191-b88d-77d331a2cd37 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.311928 Aug 24 15:48:36.960067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 142/265] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:36 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:36.996932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:36.997536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:37.018043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.019122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.019842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.020994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.021814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.022449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.180866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:37.181495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:37.201857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.202422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.202872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.203595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.204081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.204508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.208663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:37.217998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3cd53bfe-04bc-45f7-a67b-fb277b56cf6c tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.224731 Aug 24 15:48:37.232740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 124/266] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:36 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:37.281296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:37.291680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f66892ec-4b58-4754-b43e-19619153989d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1296 microversion: 2.1 time: 0.114739 Aug 24 15:48:37.307390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 143/267] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1296 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:37.439563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-2d7a2cc8-31ea-4c81-8db9-77e5454ff996 req-9248e514-cd0e-46b1-a66d-74f9371cec2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b06734-16e2-427c-be4e-872cec28af4c", "name": "network-vif-plugged", "status": "completed", "tag": "2979a8b0-d8de-4535-959a-35f7f7b87915"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:37.459139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2d7a2cc8-31ea-4c81-8db9-77e5454ff996 req-9248e514-cd0e-46b1-a66d-74f9371cec2a service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.459684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2d7a2cc8-31ea-4c81-8db9-77e5454ff996 req-9248e514-cd0e-46b1-a66d-74f9371cec2a service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.460121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2d7a2cc8-31ea-4c81-8db9-77e5454ff996 req-9248e514-cd0e-46b1-a66d-74f9371cec2a service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.487553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-2d7a2cc8-31ea-4c81-8db9-77e5454ff996 req-9248e514-cd0e-46b1-a66d-74f9371cec2a service nova] Creating event network-vif-plugged:2979a8b0-d8de-4535-959a-35f7f7b87915 for instance 80b06734-16e2-427c-be4e-872cec28af4c on hv-cinder-84932 Aug 24 15:48:37.507618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-2d7a2cc8-31ea-4c81-8db9-77e5454ff996 req-9248e514-cd0e-46b1-a66d-74f9371cec2a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071429 Aug 24 15:48:37.509393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 125/268] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:37.982072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:37.982574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:37.988704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.989225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.989660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.990604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.991059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.998443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.199304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:38.208727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-21c235e6-1558-40f5-9ecf-175e7507bb93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.231545 Aug 24 15:48:38.210000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 144/269] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:37 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:38.251677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:38.253195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:38.268915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.269856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.271875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.273205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.274002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.275139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.313469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:38.314089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:38.327169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.327789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.328231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.329167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.329916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.330533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.418561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:38.434351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-11b3ee8e-3760-4ae5-a7bc-b869077b3bc8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1302 microversion: 2.1 time: 0.120284 Aug 24 15:48:38.435620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 145/270] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:38.465610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:38.473738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fc66de9b-3c3c-4105-b8df-852492e34977 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.236887 Aug 24 15:48:38.474812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 126/271] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:38 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:39.233806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:39.234528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:39.244450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.245794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.246287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.247175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.247593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.248148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.411870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:39.421167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-95f58562-fa2a-4e69-9578-05ef4227fd60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.194790 Aug 24 15:48:39.421763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 146/272] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:39 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:39.458289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:39.459008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:39.466150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.466755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.467261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.468074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.468630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.469119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.495513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:39.496361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:39.502697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.503551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.504264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.505066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.505598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.506097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.533393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:39.685906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:39.707516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b7eb76c-faa4-49a5-86df-b399b45f19ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.252994 Aug 24 15:48:39.715418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:39.720733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 127/273] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:39.727612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9383b2c0-70e6-43da-bc0a-270f30c7ad25 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1318 microversion: 2.1 time: 0.235821 Aug 24 15:48:39.728245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 147/274] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:39 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:39.910558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1561195854", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "networks": [{"uuid": "9405d680-d420-4ddb-a838-27ee48b0820e"}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:39.968507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] validate_networks() for [('9405d680-d420-4ddb-a838-27ee48b0820e', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:48:39.977004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-91649781-b804-4b4b-97e2-b75c105538e1 req-3efdf459-1928-4f60-99eb-fbd5e01432b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a234e501-bc78-49d3-840c-65ec61718cc0", "tag": "964ad286-e8b3-4ae1-bbea-f1b129ebb9ee"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:39.986393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-91649781-b804-4b4b-97e2-b75c105538e1 req-3efdf459-1928-4f60-99eb-fbd5e01432b7 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:39.986879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-91649781-b804-4b4b-97e2-b75c105538e1 req-3efdf459-1928-4f60-99eb-fbd5e01432b7 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:39.987309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-91649781-b804-4b4b-97e2-b75c105538e1 req-3efdf459-1928-4f60-99eb-fbd5e01432b7 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:39.999474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-91649781-b804-4b4b-97e2-b75c105538e1 req-3efdf459-1928-4f60-99eb-fbd5e01432b7 service nova] Creating event network-changed:964ad286-e8b3-4ae1-bbea-f1b129ebb9ee for instance a234e501-bc78-49d3-840c-65ec61718cc0 on hv-cinder-84932 Aug 24 15:48:40.005293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-91649781-b804-4b4b-97e2-b75c105538e1 req-3efdf459-1928-4f60-99eb-fbd5e01432b7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031641 Aug 24 15:48:40.005903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 148/275] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:40.341317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:48:40.341739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:48:40.342209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:48:40.342616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:48:40.343020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:48:40.353427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.354276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.354823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.355993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.356527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.357001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.377596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Getting quotas for project c4b9035514b74d60b49d9d7e404d3b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:40.381739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Getting quotas for user 127f047b72c443eab061a22b1155e053 and project c4b9035514b74d60b49d9d7e404d3b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:40.393690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:48:40.396294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:48:40.443926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:40.445414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:40.452050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.452798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.453443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.454289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.454740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.455163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.498770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d557b300-d537-4a69-8244-cf9827274c97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.588748 Aug 24 15:48:40.499841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 128/276] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:48:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:48:40.513737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-461dd9a2-2578-4b8e-b9b0-f9d1f8377bee tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:40.514336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-461dd9a2-2578-4b8e-b9b0-f9d1f8377bee tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:40.609025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-461dd9a2-2578-4b8e-b9b0-f9d1f8377bee tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:40.619239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-461dd9a2-2578-4b8e-b9b0-f9d1f8377bee tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1223 microversion: 2.1 time: 0.109278 Aug 24 15:48:40.620817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 129/277] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:40 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:40.684838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:40.692346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fc79da24-693a-44a5-8eed-d24508f41bbf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.252906 Aug 24 15:48:40.703511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 149/278] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:40 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:40.740719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:40.741333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:40.749416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.749922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.750330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.750897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.751520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.752013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.752840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:40.754208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:40.765765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.769836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.770990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.772116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.774662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.776379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.984442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:40.989072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:40.993463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-009dd32e-faa0-4464-a1fb-aacb0e619f59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.256436 Aug 24 15:48:40.994366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 130/279] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:40.998445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3877672c-2c77-4419-844a-462b22889584 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1502 microversion: 2.1 time: 0.253237 Aug 24 15:48:40.999243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 150/280] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:40 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:41.508308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:41.508883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:41.515481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.516066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.516502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.517205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.517739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.518176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.545483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Going to try to terminate instance {{(pid=132518) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:48:41.646314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:41.646992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:41.653469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.654210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.654645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.655644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.656270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.656706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.734147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:41.747735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ef771d56-b8fd-4f68-9972-c66377a4e316 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1227 microversion: 2.1 time: 0.105923 Aug 24 15:48:41.748668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 151/281] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:41 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1227 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:41.753294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:41.753985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:41.760842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.761412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.761921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.762701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.763323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.763784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.790802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1145eb82-31df-4401-ad5c-2bddfa304554 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "DELETE /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 204 len: 0 microversion: 2.1 time: 0.286402 Aug 24 15:48:41.792049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 131/282] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:48:41 2022] DELETE /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:48:41.807393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:41.809168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:41.818077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.818836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.819423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.822414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.823047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.823614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.263009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:42.271934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5a35b51c-7f64-4abc-94be-029d200a6fe5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.522105 Aug 24 15:48:42.272523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 152/283] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:41 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:42.283824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:42.283824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:42.284522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.285031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.285453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:42.285584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.286565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.287028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.287754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.297709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2e535212-bda1-4190-9b3c-f7e408bc8c6a tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1508 microversion: 2.1 time: 0.500002 Aug 24 15:48:42.298410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 132/284] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:41 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1508 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:42.438335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:42.446614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f3c20041-d380-46c4-ac81-95339c957904 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.172906 Aug 24 15:48:42.447179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 153/285] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:42.769854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:42.770488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:42.777998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.778483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.778920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.779793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.780312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.780745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.843897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:42.853116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78446b10-0cc0-448c-92cc-f227e88efeb5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1227 microversion: 2.1 time: 0.085850 Aug 24 15:48:42.853701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 133/286] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:42 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1227 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:43.298852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:43.299534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:43.306521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.307043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.307485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.308218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.308684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.309113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.319459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:43.320935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:43.327532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.328087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.328545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.329293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.329736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.330226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.517021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:43.524288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:43.525576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-21520cd8-8d88-4fdf-9196-9ad7f8a90480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.230874 Aug 24 15:48:43.526189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 154/287] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:43 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:43.530907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:43.531514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:43.537272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.537758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.538223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f1561e22-71b0-43b9-830b-6d5339aa25a4 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1508 microversion: 2.1 time: 0.222491 Aug 24 15:48:43.538331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.539054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.539201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 134/288] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:43 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:43.539510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.539970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.678522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:43.687965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d18d0cc-a398-43fc-88ef-345c7df526f4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.160604 Aug 24 15:48:43.688761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 155/289] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:43.874938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:43.875588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:43.882066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.882638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.883366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.884260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.884758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.885187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.950711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:43.958511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-085e644e-4b7e-4336-8cf3-8f2df0a618fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1275 microversion: 2.1 time: 0.088147 Aug 24 15:48:43.959072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 135/290] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:43 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:44.548259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:44.549502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:44.557223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.557923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.558365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.559078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.559575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.560033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.560860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:44.561695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:44.569201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.570745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.571605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.573156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.574482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.574991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.844058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:44.854442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90bb05e7-9eb4-42e1-94da-9ec4db2d7c40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.310176 Aug 24 15:48:44.854812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:44.855023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 156/291] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:44 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:44.861712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:44.872015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3f52124b-6cf0-45a7-a77a-06de02c8e733 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1508 microversion: 2.1 time: 0.315507 Aug 24 15:48:44.873668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 136/292] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:44 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:44.874356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:44.889120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.889805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.890466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.891540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.892254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.893038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.986420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:44.987039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:44.996397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.996990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.997543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.998352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:44.998900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:44.999403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.216349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:45.228718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-789e3cfe-1aae-4434-b3ea-d89494a727d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1275 microversion: 2.1 time: 0.247352 Aug 24 15:48:45.229702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 137/293] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:44 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:45.239240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:45.251759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-34d4e2d6-d9bf-438a-a697-1456e1d0dd6d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.395198 Aug 24 15:48:45.252846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 157/294] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:45.692527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-100cd04b-997e-4a40-be3d-2ce5c5f743ee req-f12666dd-b71e-4d25-a495-7f7398919d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b06734-16e2-427c-be4e-872cec28af4c", "name": "network-vif-deleted", "tag": "2979a8b0-d8de-4535-959a-35f7f7b87915"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:45.703044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-100cd04b-997e-4a40-be3d-2ce5c5f743ee req-f12666dd-b71e-4d25-a495-7f7398919d46 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.703525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-100cd04b-997e-4a40-be3d-2ce5c5f743ee req-f12666dd-b71e-4d25-a495-7f7398919d46 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.703979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-100cd04b-997e-4a40-be3d-2ce5c5f743ee req-f12666dd-b71e-4d25-a495-7f7398919d46 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.715675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-100cd04b-997e-4a40-be3d-2ce5c5f743ee req-f12666dd-b71e-4d25-a495-7f7398919d46 service nova] Creating event network-vif-deleted:2979a8b0-d8de-4535-959a-35f7f7b87915 for instance 80b06734-16e2-427c-be4e-872cec28af4c on hv-cinder-84932 Aug 24 15:48:45.720455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-100cd04b-997e-4a40-be3d-2ce5c5f743ee req-f12666dd-b71e-4d25-a495-7f7398919d46 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031544 Aug 24 15:48:45.721029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 138/295] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:45.876270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:45.876861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:45.884095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.884596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.885035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.885757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.886214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.886633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.894831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:45.895656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:45.902447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.903009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.903558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.904278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.904732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.905157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.937311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:45.978315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:45.988316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:45.997203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2682ec04-f3bb-4760-babf-cfd47e581175 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1466 microversion: 2.1 time: 0.106586 Aug 24 15:48:45.997787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 139/296] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:45 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1466 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:46.046087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:46.053700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-39ef12df-326f-4094-9925-29eca34b2d34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1527 microversion: 2.1 time: 0.181641 Aug 24 15:48:46.054259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 158/297] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:45 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1527 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:46.250235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:46.250835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:46.256837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:46.257312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:46.257746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:46.258431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:46.258879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:46.259295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:46.274549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:46.275193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:46.281469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:46.281955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:46.282386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:46.283092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:46.283542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:46.283996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:46.325406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:46.333304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-242dfe36-3201-45c1-a1cf-a6e08e491c5e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1293 microversion: 2.1 time: 0.086897 Aug 24 15:48:46.333883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 140/298] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:46 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:46.421412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:46.428666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2315c50c-b3e3-483e-8030-c19c73a4504c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.158322 Aug 24 15:48:46.429229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 159/299] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:47.019053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:47.019684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:47.026673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.027157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.027589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.028309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.028760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.029178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.061500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.061989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.062430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.062882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lazy-loading 'fault' on Instance uuid 80b06734-16e2-427c-be4e-872cec28af4c {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:48:47.068670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:47.077817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:47.078417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:47.084841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.085527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.086714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.087647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.088253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.088811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.117416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e34111a3b2f4c1fb75252c4806d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e324399ad64863a994246cc04a4751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:47.126199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ec6b1407-bba3-43fb-9c45-d9c4e4985210 tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 200 len: 1308 microversion: 2.1 time: 0.110848 Aug 24 15:48:47.126941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 141/300] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:47 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:47.236799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:47.247240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-106e1733-7086-490f-ae19-f501f3de09e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1507 microversion: 2.1 time: 0.173116 Aug 24 15:48:47.251584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 160/301] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:47 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:47.268297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:47.269108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:47.275458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.276007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.276449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.277154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.277649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.278074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.354459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:47.355062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:47.362479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.363215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.364305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.366257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.367662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.368253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.461775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:47.470943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb19a986-7499-4a4b-968b-a0a600527df0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1519 microversion: 2.1 time: 0.206558 Aug 24 15:48:47.471661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 142/302] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:47 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:47.477924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:47.478540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:47.485176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.485865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.486457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.487521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.488165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.488745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.580137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:47.597689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ab114906-5621-49ed-983e-bb545e5cd04e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.246911 Aug 24 15:48:47.598453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 161/303] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:47 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:47.657360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:47.668588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8874a896-36f4-43bb-8606-347825407378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.194861 Aug 24 15:48:47.669409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 143/304] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:48.077478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-0f4ae752-eff2-4556-97f7-638d227b30ab req-e70fe1b9-d7a0-4583-b44b-b8a8fb1863f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9e687d-4b89-420b-9671-a803340a82e1", "tag": "1016ad9a-b7d2-482f-9b2b-97070093f65d"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:48.094616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0f4ae752-eff2-4556-97f7-638d227b30ab req-e70fe1b9-d7a0-4583-b44b-b8a8fb1863f8 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.096849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0f4ae752-eff2-4556-97f7-638d227b30ab req-e70fe1b9-d7a0-4583-b44b-b8a8fb1863f8 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.097566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0f4ae752-eff2-4556-97f7-638d227b30ab req-e70fe1b9-d7a0-4583-b44b-b8a8fb1863f8 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.111187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-0f4ae752-eff2-4556-97f7-638d227b30ab req-e70fe1b9-d7a0-4583-b44b-b8a8fb1863f8 service nova] Creating event network-changed:1016ad9a-b7d2-482f-9b2b-97070093f65d for instance ec9e687d-4b89-420b-9671-a803340a82e1 on hv-cinder-84932 Aug 24 15:48:48.116825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-0f4ae752-eff2-4556-97f7-638d227b30ab req-e70fe1b9-d7a0-4583-b44b-b8a8fb1863f8 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044549 Aug 24 15:48:48.118828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 162/305] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:48.151065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:48.152013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] [instance: 80b06734-16e2-427c-be4e-872cec28af4c] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:48.158481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.158984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.159403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.160233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.160687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.161056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.176751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] HTTP exception thrown: Instance 80b06734-16e2-427c-be4e-872cec28af4c could not be found. Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Request method failure captured: Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c HTTP/1.1 Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkgkCmCcGFq1eRb3cz2s2Oea_oPNvTW6MVoqr6ntMQBLCXaMLfbIKM8aQVRpmov7w4jq0bPTB82Sf2Ui2fsJ6k7mVySntcfvBJW3q0DX05u038UBs_xpTvfLX1S2EohG6uYvrcsSOPtOgAOGLpPH8IamvUAz0Qpq1VhgvG0MmNhqxNs Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 26e324399ad64863a994246cc04a4751 Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesActionsTest-1270012904 Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:48:48.178425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/26e324399ad64863a994246cc04a4751"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/26e324399ad64863a994246cc04a4751"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_26e324399ad64863a994246cc04a4751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/26e324399ad64863a994246cc04a4751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesActionsTest-1270012904 Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 26e324399ad64863a994246cc04a4751 Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesActionsTest-1270012904 Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesActionsTest-1270012904-project Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 1e34111a3b2f4c1fb75252c4806d3da4 Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesActionsTest-1270012904-project Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 80b06734-16e2-427c-be4e-872cec28af4c could not be found. Aug 24 15:48:48.180377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '80b06734-16e2-427c-be4e-872cec28af4c'} Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b06734-16e2-427c-be4e-872cec28af4c could not be found. Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:48.181444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b06734-16e2-427c-be4e-872cec28af4c could not be found. Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b06734-16e2-427c-be4e-872cec28af4c could not be found. Aug 24 15:48:48.182888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:48:48.185636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] Returning 404 to user: Instance 80b06734-16e2-427c-be4e-872cec28af4c could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:48.185636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2ed28b02-c63d-4453-ad7e-fa013911f57e tempest-VolumesActionsTest-1270012904 tempest-VolumesActionsTest-1270012904-project] 10.222.0.102 "GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c" status: 404 len: 111 microversion: 2.1 time: 0.033371 Aug 24 15:48:48.185636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 144/306] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:48 2022] GET /compute/v2.1/servers/80b06734-16e2-427c-be4e-872cec28af4c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:48:48.622658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:48.623431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:48.625502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:48.630957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.631526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.632059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.632823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.633517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.634027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.691536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:48.692280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:48.709279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.710140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.711417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.712428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.713398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.714042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.926273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:48.935417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-169e3944-e135-4a6d-8043-ba1dc8d215b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.247945 Aug 24 15:48:48.943856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 145/307] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:48.949158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:48.951656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:48.958478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.959018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.959659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.960455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.961540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.962093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.990017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:49.001123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-555ac742-b61e-4528-9aba-c1947f729c58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.382445 Aug 24 15:48:49.002025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 163/308] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:48 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:49.009066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lazy-loading 'flavor' on Instance uuid 3b76a210-7149-41db-9f03-84c996c8ee63 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:48:49.094297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b5efc61-2ec2-4932-897e-8d72feffaf2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/action" status: 200 len: 32 microversion: 2.1 time: 0.156167 Aug 24 15:48:49.094900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 146/309] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:48:48 2022] POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:48:49.104427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:49.105161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:49.111163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.111672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.112104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:49.112795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.113245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.113662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:49.322052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:49.330022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c263d414-f79b-481a-b86c-ceb2069fc380 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.229465 Aug 24 15:48:49.330522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 164/310] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:49 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:49.958016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:49.958711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:49.961319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:49.967499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.968019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.968453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:49.969149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.969603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.970034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:50.023020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:50.024481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:50.032060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:50.032714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:50.033162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:50.035501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:50.035997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:50.036429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:50.041727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:50.151174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:50.159068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bca34077-c2bb-4b56-9c74-3b893b4df897 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.205709 Aug 24 15:48:50.159650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 147/311] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:50.196392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:50.204508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9ca97b94-b6e8-4323-b2b7-2e89b6865424 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.186003 Aug 24 15:48:50.205078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 165/312] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:50 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:50.350795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:50.351366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:50.357646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:50.358130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:50.358564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:50.359257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:50.359730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:50.360159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:50.375019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:50.489139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:50.497661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e638c86a-c52f-4b16-8033-c4b316f6fd44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.150832 Aug 24 15:48:50.498223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 148/313] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:50 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:51.180416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:51.181031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:51.187047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:51.187530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:51.188004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.188703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:51.189161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:51.189589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.225913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:51.227205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:51.229099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=14 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:51.234915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:51.235412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:51.235874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.236583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:51.237037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:51.237470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.368910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:51.376695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fde91460-b8f9-4615-96e7-f41c10b119f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.200593 Aug 24 15:48:51.377260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 166/314] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:51.400123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:51.407685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3931caf4-8321-4ee8-99d4-15254baf4241 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.185730 Aug 24 15:48:51.408244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 149/315] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:51 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:51.518958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:51.519521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:51.526499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:51.526983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:51.527420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.528149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:51.528611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:51.529039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.658110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:51.665684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-59b1b0ff-53fb-4a37-bf38-e68cd527a1bc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.150626 Aug 24 15:48:51.666227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 167/316] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:51 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:52.398892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:52.400046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:52.406141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.406627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.407057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.407772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.408222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.408638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.428687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:52.429309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:52.435880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.436456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.436965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.437763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.438418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.438908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.610087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:52.618328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d3cfe62b-8a8d-41ba-8db7-8bf87c959b95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.223865 Aug 24 15:48:52.618988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 150/317] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:52.619467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:52.627211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6f5a0237-01a4-4d31-ae30-4c23fb7ad6b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.202701 Aug 24 15:48:52.627794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 168/318] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:52 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:52.685987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:52.686523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:52.692481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.692972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.693401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.694088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.694544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.694963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.830450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:52.840006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6ae517e1-aa23-4e15-a7f6-f7c89ea76c8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.157805 Aug 24 15:48:52.840592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 151/319] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:52 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:53.639377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:53.640016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:53.646004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.646494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.646926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:53.647032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:53.647616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:53.647759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.648096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.648722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:53.654056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.654538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.655606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:53.656337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.656838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.657195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:53.850022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:53.853669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:53.858735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-60b6224d-fbea-479b-b899-c0c98b2c2700 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.223216 Aug 24 15:48:53.859399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 169/320] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:53.863948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:53.864629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:53.866532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2a9d31a6-1efa-4bd3-b849-56b452c2f971 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.222752 Aug 24 15:48:53.868431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 152/321] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:53 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:53.871719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.872283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.872793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:53.873496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.873951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.874373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:54.005539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:54.013463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5dccce8f-13e2-4fe8-aa82-f3118dabff5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.153054 Aug 24 15:48:54.014016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 170/322] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:53 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:54.885065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:54.885683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:54.888688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:54.889362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:54.892668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:54.893149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:54.893579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:54.894273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:54.894719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:54.895137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:54.895332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:54.895823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:54.896261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:54.896949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:54.897404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:54.897841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:55.115306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:55.124360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3f666127-09d5-48f4-b2d1-b4a76d506b94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.243800 Aug 24 15:48:55.124664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:55.124938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 153/323] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:55.130131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:55.130734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:55.136120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-751908dd-883e-4e48-9ee6-3af949ef9ddc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.251370 Aug 24 15:48:55.136946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 171/324] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:54 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:55.137229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:55.137790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:55.138231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:55.138937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:55.139946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:55.139946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:55.271057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:55.278709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4f3fc533-9655-4762-a369-06a25f1b37af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.152834 Aug 24 15:48:55.279284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 154/325] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:55 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:56.144964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:56.146270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:56.156690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:56.157361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:56.159383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.162008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.163342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.165152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.168142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.168559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.168681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.169338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.170463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.171202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.171684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.176042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.712323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:56.724073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cd13dceb-5658-4b4c-ba5b-4a50c6e0361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.582763 Aug 24 15:48:56.736961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 172/326] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:56.743933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:56.744790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:56.751387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.752152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.752805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.753702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.754349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.754962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.760098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:56.771000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01331af7-6167-47ff-b11f-07dcc8ff3bac tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.618398 Aug 24 15:48:56.771981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 155/327] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:56 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:56.778443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-c0fa522f-f2ee-4ba6-aa74-194dab1b28a4 req-bfba8977-bc63-41a3-b778-93dd45ce6f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a234e501-bc78-49d3-840c-65ec61718cc0", "name": "network-vif-plugged", "status": "completed", "tag": "964ad286-e8b3-4ae1-bbea-f1b129ebb9ee"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:56.790249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c0fa522f-f2ee-4ba6-aa74-194dab1b28a4 req-bfba8977-bc63-41a3-b778-93dd45ce6f81 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:56.791020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c0fa522f-f2ee-4ba6-aa74-194dab1b28a4 req-bfba8977-bc63-41a3-b778-93dd45ce6f81 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:56.791840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c0fa522f-f2ee-4ba6-aa74-194dab1b28a4 req-bfba8977-bc63-41a3-b778-93dd45ce6f81 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:56.835133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-c0fa522f-f2ee-4ba6-aa74-194dab1b28a4 req-bfba8977-bc63-41a3-b778-93dd45ce6f81 service nova] Creating event network-vif-plugged:964ad286-e8b3-4ae1-bbea-f1b129ebb9ee for instance a234e501-bc78-49d3-840c-65ec61718cc0 on hv-cinder-84932 Aug 24 15:48:56.870669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-c0fa522f-f2ee-4ba6-aa74-194dab1b28a4 req-bfba8977-bc63-41a3-b778-93dd45ce6f81 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085526 Aug 24 15:48:56.890621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 156/328] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:57.048672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:57.063431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-31e81fdd-1798-48ff-bdfa-fc01dfd443ac tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.324949 Aug 24 15:48:57.064241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 173/329] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:56 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:57.749638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:57.750430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:57.758789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:57.759433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:57.760025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:57.760968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:57.761494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:57.761986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:57.779548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:57.793275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:57.793992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:57.805292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:57.806302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:57.806922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:57.807859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:57.811337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:57.812226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:58.016085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:58.025282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9e784c19-6483-464b-a8d2-c1015498e084 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.280155 Aug 24 15:48:58.025866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 157/330] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:58.040995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:58.052176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4aa07a5-3097-4b9d-921b-66bcdc81fef2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.263767 Aug 24 15:48:58.052841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 174/331] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:57 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:58.089547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:58.089547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:58.097467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:58.098321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:58.098452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:58.099709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:58.100121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:58.100465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:58.320886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:58.322369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:58.349935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:58.350447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:58.350886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:58.352307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:58.352795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:58.353384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:58.356662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:58.367020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7084686f-7651-474f-a5e8-750577c1f75d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.283262 Aug 24 15:48:58.392016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 158/332] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:58 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:58.448430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-986be16d-69dc-4dad-9cf0-0e3eabf0df22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/ips" status: 200 len: 152 microversion: 2.20 time: 0.135175 Aug 24 15:48:58.458061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 175/333] 10.222.0.102 () {60 vars in 1294 bytes} [Wed Aug 24 15:48:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/ips => generated 152 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:48:59.048031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:59.048715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:59.065837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:59.067999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:59.077871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:59.078473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:59.083729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:59.084635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:59.091094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:59.091709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:59.095331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:59.102691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:59.103955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:59.104695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:59.105151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:59.108299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:59.318320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:59.321478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:59.326821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-243e6694-074e-4d75-92f0-eca50761e1a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.254670 Aug 24 15:48:59.328696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 176/334] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:59 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:59.329466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e9cfe67f-6e77-4549-8e50-839f26d43335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1369 microversion: 2.1 time: 0.286913 Aug 24 15:48:59.330335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 159/335] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1369 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:59.400552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:59.401368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:59.407708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:59.408198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:59.408630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:59.409326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:59.409937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:59.410533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:59.553916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:59.569770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b728eb7a-641f-4bc2-bfa7-31dfcdb149fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.175056 Aug 24 15:48:59.570762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 177/336] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:48:59 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:00.339247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-0ad447f7-3220-4028-bde3-aec70b2aca32 req-b1608d47-af96-4943-bfe3-74f959b0f1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9e687d-4b89-420b-9671-a803340a82e1", "name": "network-vif-plugged", "status": "completed", "tag": "1016ad9a-b7d2-482f-9b2b-97070093f65d"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:00.350549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:00.351348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:00.369631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.373852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.375453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.385757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-0ad447f7-3220-4028-bde3-aec70b2aca32 req-b1608d47-af96-4943-bfe3-74f959b0f1ef service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.386134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.386763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.387411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.392456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-0ad447f7-3220-4028-bde3-aec70b2aca32 req-b1608d47-af96-4943-bfe3-74f959b0f1ef service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.393582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-0ad447f7-3220-4028-bde3-aec70b2aca32 req-b1608d47-af96-4943-bfe3-74f959b0f1ef service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.416940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-0ad447f7-3220-4028-bde3-aec70b2aca32 req-b1608d47-af96-4943-bfe3-74f959b0f1ef service nova] Creating event network-vif-plugged:1016ad9a-b7d2-482f-9b2b-97070093f65d for instance ec9e687d-4b89-420b-9671-a803340a82e1 on hv-cinder-84932 Aug 24 15:49:00.431466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-0ad447f7-3220-4028-bde3-aec70b2aca32 req-b1608d47-af96-4943-bfe3-74f959b0f1ef service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097372 Aug 24 15:49:00.432911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 160/337] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:49:00.439335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:00.440359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:00.449597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.450380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.451023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.452003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.452658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.453431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.671861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:00.684486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b2b05f4-3c08-4e2d-ae3d-f54ca0a0e65e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.338309 Aug 24 15:49:00.686100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 178/338] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:00 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:00.694263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:00.694885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:00.705933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:00.712501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.715256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.715750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.716485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.718635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.719389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.722263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-70d7df70-8761-4c16-bd84-df45d648aecf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1559 microversion: 2.1 time: 0.287323 Aug 24 15:49:00.723607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 161/339] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1559 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:00.747480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:00.748822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:00.757051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.758446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.759120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.760372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:00.761389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:00.761976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:00.924346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0787324c-c4d7-4c8a-b188-5c5433d95cae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183929 Aug 24 15:49:00.925541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 162/340] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 15:49:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:00.977077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:00.986614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7a19b617-c8bf-43b9-801e-c971ba3a85e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.299371 Aug 24 15:49:00.987225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 179/341] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:00 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:01.707695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:01.708379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:01.717559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:01.718404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:01.719168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:01.720242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:01.720890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:01.721730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:01.818974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:01.819535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:01.831720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:01.832225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:01.834606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:01.836871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:01.837461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:01.837903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:01.872028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:01.882200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8a8d85b0-9952-44bb-9b84-5de1a7f28f3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.179536 Aug 24 15:49:01.884076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 163/342] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:01 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:01.887413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lazy-loading 'flavor' on Instance uuid 4f595382-be87-4054-8542-60e6dfeba11d {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:49:01.992527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:02.011153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:02.011830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:02.020039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.020949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.021656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:02.022811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.023962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.025017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:02.263777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:02.273110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-81950692-9993-44e5-b078-abc629fd9876 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.267033 Aug 24 15:49:02.280747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6954ddc0-bfb4-4e98-9e85-6d210909f3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/action" status: 202 len: 0 microversion: 2.20 time: 0.465733 Aug 24 15:49:02.281690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 180/343] 10.222.0.102 () {62 vars in 1324 bytes} [Wed Aug 24 15:49:01 2022] POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:49:02.284093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 164/344] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:02 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:02.286972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-77d1d97f-abe4-4f47-b2c6-0f31059cd988 req-42b7fb37-6b4b-49b5-aae2-21e92767c601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a234e501-bc78-49d3-840c-65ec61718cc0", "tag": "964ad286-e8b3-4ae1-bbea-f1b129ebb9ee"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:02.298486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-77d1d97f-abe4-4f47-b2c6-0f31059cd988 req-42b7fb37-6b4b-49b5-aae2-21e92767c601 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.299041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-77d1d97f-abe4-4f47-b2c6-0f31059cd988 req-42b7fb37-6b4b-49b5-aae2-21e92767c601 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.299412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-77d1d97f-abe4-4f47-b2c6-0f31059cd988 req-42b7fb37-6b4b-49b5-aae2-21e92767c601 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:02.299624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:02.300281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:02.308084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.308495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.308937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:02.310022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.310409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.310849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:02.311387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-77d1d97f-abe4-4f47-b2c6-0f31059cd988 req-42b7fb37-6b4b-49b5-aae2-21e92767c601 service nova] Creating event network-changed:964ad286-e8b3-4ae1-bbea-f1b129ebb9ee for instance a234e501-bc78-49d3-840c-65ec61718cc0 on hv-cinder-84932 Aug 24 15:49:02.316691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-77d1d97f-abe4-4f47-b2c6-0f31059cd988 req-42b7fb37-6b4b-49b5-aae2-21e92767c601 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033524 Aug 24 15:49:02.317290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 181/345] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:49:02.536920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:02.546271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:02.548828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:02.550148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-65e0aded-ca4a-4600-ac96-a39df7be1fa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.256166 Aug 24 15:49:02.551048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 165/346] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:02.909091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:02.909810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:02.917957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.919127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.919570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:02.920595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:02.921229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:02.921984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:03.086144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:03.096129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1880005e-831c-4313-a611-8f1865ebbdf9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.191723 Aug 24 15:49:03.096927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 182/347] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:02 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:03.299864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:03.301456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:03.309293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:03.310021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:03.310619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:03.311868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:03.312639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:03.313246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:03.477741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:03.487207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ff0f8745-a4c0-4a1c-8f94-cfb3ed9f444b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.190953 Aug 24 15:49:03.500012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 166/348] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:03 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:03.576933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:03.577387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:03.602845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:03.607858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:03.608553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:03.609487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:03.611255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:03.611769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:03.876452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:03.890748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:03.894514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:03.897273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ac1dacf-263c-4acf-99ba-715555430726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.326299 Aug 24 15:49:03.899546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 183/349] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:04.120976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:04.121657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:04.128036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:04.128455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:04.128894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:04.129574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:04.130025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:04.130440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:04.273075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:04.282196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-944669a7-26ae-4496-9f79-4160ebffb23c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.167814 Aug 24 15:49:04.283072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 167/350] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:04 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:04.512454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:04.513198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:04.519691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:04.520303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:04.521188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:04.522141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:04.522685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:04.523651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:04.694145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:04.704494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e67b43b-524a-47df-93cd-320c1df636d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.197829 Aug 24 15:49:04.705680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 184/351] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:04 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:04.937217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:04.939452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:04.950528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:04.951135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:04.951581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:04.952367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:04.952823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:04.953248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:05.120312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:05.129607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:05.131571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:05.133352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-30c43b33-7654-4116-b5ff-3faf0001b3b3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.203856 Aug 24 15:49:05.134298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 168/352] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:05.307725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:05.308603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:05.317699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:05.318484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:05.319011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:05.321808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:05.322432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:05.323087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:05.562450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:05.579759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-337d7cf7-8ce9-4047-ad2f-512778510d1f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1323 microversion: 2.1 time: 0.276525 Aug 24 15:49:05.580660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 185/353] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:05 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:05.730524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:05.732160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:05.738464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:05.739416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:05.751250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:05.752052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:05.752536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:05.752972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:06.015837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:06.024293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c83ae8f2-7180-4a96-b424-b5864a632fd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.301999 Aug 24 15:49:06.043801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 169/354] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:05 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:06.161408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:06.162202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:06.183018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:06.184139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:06.185733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:06.187404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:06.188357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:06.188793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:06.335150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:06.348285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:06.350115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:06.356214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f5724239-8e50-44a7-ab66-752249cd2130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.198723 Aug 24 15:49:06.356786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 186/355] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:06.603553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:06.604820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:06.611085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:06.611864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:06.612536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:06.613486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:06.614130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:06.614974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:06.766408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:06.775297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01ce405b-d305-49c4-8032-e4b99ffd45cb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1511 microversion: 2.1 time: 0.176767 Aug 24 15:49:06.777200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 170/356] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:06 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:07.046277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:07.048031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:07.059797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:07.061384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:07.062928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:07.065619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:07.066852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:07.067734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:07.358740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:07.373548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f800f00e-604f-4a7e-9e90-29213564a24b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.331055 Aug 24 15:49:07.375384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 187/357] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:07 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:07.380818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:07.382015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:07.389128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:07.389625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:07.390257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:07.391597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:07.392631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:07.393491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:07.579236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:07.590002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:07.591802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:07.593093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-017b4aec-b3ea-449f-8cd1-6e61ba4ed235 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.216037 Aug 24 15:49:07.593684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 171/358] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:08.399958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:08.401334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:08.409606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:08.410432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:08.411306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:08.413027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:08.413561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:08.414125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:08.557549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:08.565128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-17e4a2e1-4b04-417e-9e4a-72de6ec224f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.169338 Aug 24 15:49:08.565711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 188/359] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:08 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:08.618992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:08.619584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:08.626010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:08.626487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:08.626916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:08.627596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:08.628207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:08.628631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:08.764060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:08.772882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:08.775031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:08.776240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c864d6f9-5994-4159-9ae7-0a25a883d9d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.161820 Aug 24 15:49:08.776800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 172/360] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:09.586993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:09.587749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:09.595427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:09.596298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:09.596513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:09.597317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:09.597681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:09.598121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:09.739367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:09.748553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de171fc1-b080-4ba5-b1f7-b31ffd6d6801 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.165993 Aug 24 15:49:09.749387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 189/361] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:09 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:09.799785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:09.800411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:09.808470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:09.808955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:09.809394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:09.810113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:09.810572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:09.811005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:09.967382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:09.981201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:09.983105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:09.984770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-83a238e8-4b5f-48a2-b6ec-adb9a5dcca8c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.188896 Aug 24 15:49:09.985476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 173/362] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:10.773156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:10.774167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:10.790633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:10.791405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:10.792138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:10.792880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:10.793499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:10.794094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:10.950256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:10.959893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2c15e653-0b33-4605-b98c-cbe24bf5cf48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.192811 Aug 24 15:49:10.960729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 190/363] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:10 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:11.011333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:11.012228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:11.020623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:11.021107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:11.021544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:11.022479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:11.022878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:11.023552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:11.224988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:11.243880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:11.247096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:11.249226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f879f8f-0a62-497b-ac43-dc7e226c2322 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.242991 Aug 24 15:49:11.250689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 174/364] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:11.985932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:11.986726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:11.998461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:11.998956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:11.999389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:12.000189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:12.000664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:12.001247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:12.189695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:12.200015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6963321-ce84-45ba-9752-be251c2e6861 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.221112 Aug 24 15:49:12.200925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 191/365] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:11 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:12.278020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:12.278752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:12.286052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:12.286666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:12.287252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:12.288105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:12.288662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:12.289784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:12.294121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:12.447523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:12.458303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:12.460222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:12.462008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a4158ac-e54a-44fa-ba5f-2590f7a370ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.188041 Aug 24 15:49:12.462744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 175/366] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:13.226134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:13.228246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:13.238380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:13.238896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:13.239752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:13.241366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:13.244112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:13.244784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:13.409104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:13.417838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1054b85b-df91-4fe0-9cf2-d484acba4b47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.198795 Aug 24 15:49:13.418581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 192/367] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:13 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:13.489900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:13.491159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:13.503609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:13.505422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:13.505945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:13.506931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:13.507505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:13.508578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:13.663560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:13.674298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:13.675922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:13.677185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-43dc5191-fc45-4d1c-a451-07f5fc31f6fd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.191227 Aug 24 15:49:13.677787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 176/368] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:14.441660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:14.442906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:14.450741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:14.451323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:14.451897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:14.452782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:14.453120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:14.453541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:14.591954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:14.602481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10e5fcdd-e727-4333-b9d9-fa6af6fb2966 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.163479 Aug 24 15:49:14.603715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 193/369] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:14 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:14.706241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:14.706814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:14.715821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:14.716324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:14.716764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:14.717479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:14.717941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:14.718370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:14.889547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:14.898068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:14.901055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:14.902438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-de2b8c84-fcfb-4b9c-b5d2-f668c806ee2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.201236 Aug 24 15:49:14.903110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 177/370] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:15.625741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:15.626503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:15.634153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:15.634890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:15.635747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:15.637071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:15.637838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:15.638764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:15.798217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:15.806062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c06deff7-e33a-4f11-89f1-7ca2e071a5b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.184750 Aug 24 15:49:15.806626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 194/371] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:15 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:15.929773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:15.930829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:15.940394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:15.940882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:15.941315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:15.942251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:15.942702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:15.943181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:16.096090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:16.107125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:16.108938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:16.110238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f39958fd-a144-48df-97da-979a0815629a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.185184 Aug 24 15:49:16.111116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 178/372] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:16.826861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:16.827482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:16.834093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:16.834664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:16.835193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:16.835995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:16.836588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:16.837152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:17.005280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:17.014709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4cd3bc9a-3ae2-44cc-bf76-642636d8b8f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.191953 Aug 24 15:49:17.015660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 195/373] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:16 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:17.135423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:17.136087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:17.143037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:17.143926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:17.144431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:17.145171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:17.145869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:17.146521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:17.281458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:17.290454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:17.292266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:17.293644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d30895c8-99b1-4ba6-9e21-496ce94229f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.163306 Aug 24 15:49:17.294211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 179/374] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:18.037263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:18.037865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:18.049294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:18.050046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:18.050684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:18.051378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:18.051872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:18.052495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:18.201239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:18.208862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eab98203-fb31-4233-b0cf-beaf052066b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.175436 Aug 24 15:49:18.209422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 196/375] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:18 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:18.317402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:18.318033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:18.326279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:18.326916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:18.327597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:18.328467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:18.328925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:18.329468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:18.474336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:18.487169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:18.488752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:18.489999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5930c152-ff16-4215-a5bc-3872220307f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.176625 Aug 24 15:49:18.490655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 180/376] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:19.232649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:19.234475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:19.238966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=68 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:19.258991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:19.258991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:19.258991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:19.258991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:19.259577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:19.259577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:19.265361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:19.402747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:19.410954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9ab3bdf0-077f-4841-8aec-6a29a058c448 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.184104 Aug 24 15:49:19.411852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 197/377] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:19 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:19.515527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:19.516139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:19.524935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:19.525463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:19.526183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:19.526976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:19.527542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:19.528139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:19.693719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:19.703071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:19.704556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:19.705712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fbde37c0-699f-46cb-b614-03ccc873c8f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1726 microversion: 2.20 time: 0.194404 Aug 24 15:49:19.706264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 181/378] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1726 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:20.434977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:20.435584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:20.441497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:20.441983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:20.442412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:20.443101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:20.443554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:20.444074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:20.614320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:20.623828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-38ca832d-809c-461d-be97-fdb3e5a1def6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.192899 Aug 24 15:49:20.625153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 198/379] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:20 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:20.729264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:20.729849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:20.735470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=70 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:20.737628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:20.738342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:20.738789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:20.739714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:20.740170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:20.740769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:20.900751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:20.910776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:20.912334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:20.914156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e604eab4-7bb2-44a3-b736-76c090358ca3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1747 microversion: 2.20 time: 0.189449 Aug 24 15:49:20.916042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 182/380] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1747 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:21.645434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:21.646037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:21.652525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:21.653035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:21.653459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:21.654169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:21.654616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:21.655035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:21.787122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:21.795740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a8a39f4d-05be-40b3-9110-236756c2cd76 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.154159 Aug 24 15:49:21.796312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 199/381] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:21 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:21.939309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:21.939965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:21.947113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:21.947605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:21.948073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:21.948767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:21.949252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:21.949681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:22.089286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:22.100350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:22.101834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:22.103026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1054dbe0-57e2-4f2c-960d-8625c6243999 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1747 microversion: 2.20 time: 0.167737 Aug 24 15:49:22.103573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 183/382] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:22.390779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-61f3960b-392e-4bbf-b09b-8ff1f82afc00 req-c50d5e40-2ab1-4dff-98e2-6015c2a3a7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "name": "network-vif-plugged", "status": "completed", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:22.401809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-61f3960b-392e-4bbf-b09b-8ff1f82afc00 req-c50d5e40-2ab1-4dff-98e2-6015c2a3a7bf service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:22.402298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-61f3960b-392e-4bbf-b09b-8ff1f82afc00 req-c50d5e40-2ab1-4dff-98e2-6015c2a3a7bf service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:22.402778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-61f3960b-392e-4bbf-b09b-8ff1f82afc00 req-c50d5e40-2ab1-4dff-98e2-6015c2a3a7bf service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:22.416508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-61f3960b-392e-4bbf-b09b-8ff1f82afc00 req-c50d5e40-2ab1-4dff-98e2-6015c2a3a7bf service nova] Creating event network-vif-plugged:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 15:49:22.421934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-61f3960b-392e-4bbf-b09b-8ff1f82afc00 req-c50d5e40-2ab1-4dff-98e2-6015c2a3a7bf service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034824 Aug 24 15:49:22.422572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 200/383] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:22.817296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:22.817911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:22.824577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:22.825062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:22.825605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:22.826327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:22.826784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:22.827210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:22.974633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:22.984208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ef13c3b0-797d-4e95-9f38-b2a66dd34c1b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.170520 Aug 24 15:49:22.984854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 184/384] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:22 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:23.126276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:23.127006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:23.134414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:23.134921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:23.135377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:23.136141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:23.136607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:23.137108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:23.281021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:23.290948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:23.291303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:23.292162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:23.296130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:23.297560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cb098a44-b5b9-4934-94a0-758dd4cb0264 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1747 microversion: 2.20 time: 0.175552 Aug 24 15:49:23.298279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 201/385] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1747 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:23.312865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:23.313660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:23.314327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:23.315203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:23.315773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:23.316266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:23.343867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-664a80a3-5310-4f30-bd0c-a7e2e829740d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/ips" status: 200 len: 146 microversion: 2.1 time: 0.056980 Aug 24 15:49:23.344964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 185/386] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:49:23 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:24.006337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:24.006950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:24.013490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:24.013986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:24.014432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:24.015140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:24.015593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:24.016046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:24.157340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:24.165104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22361c00-2b66-482f-973f-26f7eb1be688 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.162593 Aug 24 15:49:24.166378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 202/387] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:24 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:24.321288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:24.323092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:24.329611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:24.330091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:24.330520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:24.331202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:24.331679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:24.332094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:24.467971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:24.476138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:24.477639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:24.479072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-17d743fe-ce6e-470c-83b2-41afa53f4c17 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1747 microversion: 2.20 time: 0.161581 Aug 24 15:49:24.479646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 186/388] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:25.189607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:25.190228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:25.196315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:25.197551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:25.198669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:25.199384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:25.199904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:25.200338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:25.336691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:25.345335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-214cf016-ec9f-4a4c-ad9c-5373a331bfba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.159623 Aug 24 15:49:25.345901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 203/389] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:25 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:25.501644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:25.502246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:25.508896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:25.510172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:25.510172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:25.511211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:25.511692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:25.512122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:25.644242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:25.652485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:25.653984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:25.655126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-adf9c60b-9691-455c-9322-89d7bfbb932e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.157491 Aug 24 15:49:25.655700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 187/390] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:26.365702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:26.366866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:26.373497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.373984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.374413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.375105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.375556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.376064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.523053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:26.533061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf0e1a20-12c3-48a6-bdf6-9359f9976290 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1505 microversion: 2.1 time: 0.170925 Aug 24 15:49:26.534491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 204/391] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:26 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:26.555156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "737e8567-c6a6-4c46-a391-cce0edc0df52"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:26.558547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:26.565024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.565508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.565940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.566644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.567097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.567518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.590816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] HTTP exception thrown: Cannot 'attach_volume' instance 3b76a210-7149-41db-9f03-84c996c8ee63 while it is in vm_state rescued Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Request method failure captured: Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/os-volume_attachments HTTP/1.1 Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 74 Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkfwULJlZGKgX95heJf4zmfQ6lCot_jPsLm-uuJLOBYiTPd61Rpfd0r80qfrelDBVdp4_oRyr_KhacfwrVs7iJON0EExXBaJ12WgjncP4WQXgRdN9Qp4mwuq9HArNdls9ZOGzY3kTZ97wq-9MdyseP-yVzdtWRe3QQYdoDmWwCmTPsw Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:49:26.592547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 2fe5724620da46ddbefbdfd442dc8d73 Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {"volumeAttachment": {"volumeId": "737e8567-c6a6-4c46-a391-cce0edc0df52"}} Aug 24 15:49:26.594137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Cannot 'attach_volume' instance 3b76a210-7149-41db-9f03-84c996c8ee63 while it is in vm_state rescued Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'server_id': '3b76a210-7149-41db-9f03-84c996c8ee63', 'body': {'volumeAttachment': {'volumeId': '737e8567-c6a6-4c46-a391-cce0edc0df52'}}} Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:49:26.595017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3b76a210-7149-41db-9f03-84c996c8ee63 while it is in vm_state rescued Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:49:26.596552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3b76a210-7149-41db-9f03-84c996c8ee63 while it is in vm_state rescued Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Returning 409 to user: Cannot 'attach_volume' instance 3b76a210-7149-41db-9f03-84c996c8ee63 while it is in vm_state rescued {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c0717738-7b08-4a34-a7f6-3f39f35e292d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043638 Aug 24 15:49:26.597926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 188/392] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:49:26 2022] POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:49:26.605004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:26.605552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:26.611617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.612148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.612726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.613285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.613746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.614296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.679748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:26.680463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:26.689379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7682aa51-aff6-4025-83cc-4de5115be67a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/action" status: 202 len: 0 microversion: 2.1 time: 0.089158 Aug 24 15:49:26.693277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 205/393] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:49:26 2022] POST /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:49:26.693420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.693420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.693420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.693737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.694120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.694891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.700218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:26.700929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:26.707730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.708224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.708660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.709364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:26.709828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:26.710252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:26.925704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:26.930572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:26.937299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:26.939179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3834a33f-f130-4b3d-af45-90cd8b46fe8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1513 microversion: 2.1 time: 0.244466 Aug 24 15:49:26.939809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 206/394] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:26 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:26.943468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:26.944758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-38433004-cd8c-46e3-a68e-dedbe86fa7dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.269234 Aug 24 15:49:26.945305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 189/395] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:27.113366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0209559-3a17-48fd-bd66-3554f5b301df"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:27.116697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:27.122992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:27.123484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:27.123941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:27.124831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:27.125700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:27.126576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:27.468684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fc39f785-15a1-4c1a-af21-0c75ca812f4f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359078 Aug 24 15:49:27.474684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 207/396] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:49:27 2022] POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:49:27.961651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:27.962918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:27.969432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:27.970310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:27.975859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:27.976349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:27.976781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:27.977650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:27.978634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:27.979022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:27.984941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:27.985392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:27.987076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:27.988012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:27.988533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:27.988924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:28.266933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:28.287786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:28.300772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:28.303102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1ddd9905-8854-4a5e-b623-6168c491ee05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.337524 Aug 24 15:49:28.308594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 208/397] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:28.346666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:28.358460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b156e325-77dd-4cbd-bddd-4bd9137d33fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1513 microversion: 2.1 time: 0.400701 Aug 24 15:49:28.359734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 190/398] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:27 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:29.354678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:29.356363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:29.372211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:29.372790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:29.373404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:29.374273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:29.374993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:29.375559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:29.381667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:29.381667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:29.390602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:29.391833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:29.392815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:29.393734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:29.394390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:29.395050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:29.653096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:29.668027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:29.668644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:29.670220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:29.671812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2fb7e289-8a19-47d0-aa8d-b0163341d1d6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.324532 Aug 24 15:49:29.672520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 209/399] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:29.678983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-09f4bf10-1609-4c04-8b8b-932d4ce71d0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1513 microversion: 2.1 time: 0.302064 Aug 24 15:49:29.680877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 191/400] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:29 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:30.716215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:30.716978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:30.721100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:30.721719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:30.723683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:30.724431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:30.725022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:30.725888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:30.726621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:30.727210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:30.739242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:30.744576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:30.746106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:30.746913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:30.747564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:30.748671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:30.776215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:31.071113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:31.081432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee6a811a-e7ba-4ecc-a054-9e4d2712197a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1513 microversion: 2.1 time: 0.370541 Aug 24 15:49:31.082020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 210/401] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:30 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1513 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:31.122419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:31.141687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:31.143614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:31.144895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3dcb07d2-1455-4062-a708-71a163eed650 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.428922 Aug 24 15:49:31.145833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 192/402] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:32.105792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:32.107157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:32.113921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:32.114642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:32.115258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:32.116163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:32.117489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:32.118080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:32.170516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:32.172398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:32.188527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:32.190428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:32.191052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:32.193453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:32.194149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:32.194751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:32.398572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:32.407529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9febed80-a04e-4041-b32d-8257b3bcd077 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1519 microversion: 2.1 time: 0.308010 Aug 24 15:49:32.408575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 211/403] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:32 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:32.417644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-638452584", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:32.467513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:32.476257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:32.478155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:32.479554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-912b27fb-e58a-42d1-9d8e-0273f75e893b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.314864 Aug 24 15:49:32.480237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 193/404] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:33.105089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fcc78b2f-4409-4bd2-8c1b-6637337ee688 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:33.112031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc78b2f-4409-4bd2-8c1b-6637337ee688 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:33.112941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc78b2f-4409-4bd2-8c1b-6637337ee688 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:33.113378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc78b2f-4409-4bd2-8c1b-6637337ee688 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:33.188113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fcc78b2f-4409-4bd2-8c1b-6637337ee688 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Going to try to stop instance {{(pid=132518) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 15:49:33.240582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fcc78b2f-4409-4bd2-8c1b-6637337ee688 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action" status: 202 len: 0 microversion: 2.1 time: 0.139671 Aug 24 15:49:33.241443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 194/405] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:49:33 2022] POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:49:33.250773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:33.251477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:33.258326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:33.258815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:33.259281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:33.260556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:33.261629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:33.265018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:33.443700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:33.454016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d91cb239-a4d5-4927-9e54-e5e8c7364920 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.207286 Aug 24 15:49:33.454795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 195/406] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:33 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:33.509828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:33.510576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:33.520107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:33.521212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:33.524275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:33.525249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:33.525841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:33.526363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:33.734423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:33.753654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:33.755724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:33.757053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c226bd5-389f-4df2-ae41-053fbb6dac54 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.251378 Aug 24 15:49:33.757875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 196/407] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:33.875665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d6ce16bf-3774-4c56-82da-4346b5663c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'create', calling method: .version_select at 0x7fc5cca1b820>, body: {"keypair": {"name": "tempest-keypair-1003450538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9jtimiEl2tMSldFewS7q2xPLbQquQv/qM+/Bjc4+MKEOOu8suj3O3d2RnSyo9g1S0JxmEcp4oyjxYOWAhiWsT93zKCTDQHAWTKeW+ciiF9GPmyUAHBxVjTRZ1+qq6z+A=="}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:33.903079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-d6ce16bf-3774-4c56-82da-4346b5663c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:49:33.909078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-d6ce16bf-3774-4c56-82da-4346b5663c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for user 2fe5724620da46ddbefbdfd442dc8d73 and project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:49:33.938606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d6ce16bf-3774-4c56-82da-4346b5663c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066644 Aug 24 15:49:33.939222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 197/408] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 15:49:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:34.476515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:34.477880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:34.489772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:34.490289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:34.490740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:34.491491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:34.491987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:34.492461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:34.652138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:34.671128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5616cc53-ede2-43c7-a4c4-14e111cac32d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.199492 Aug 24 15:49:34.672263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 198/409] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:34 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:34.780925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:34.781729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:34.787811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:34.788421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:34.788957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:34.789732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:34.790264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:34.790799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:35.007171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:35.017843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:35.021039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:35.022672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7bfbb65c-fc27-471e-8b8a-21e1c47a1a81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1742 microversion: 2.20 time: 0.245769 Aug 24 15:49:35.023846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 199/410] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1742 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:35.605096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-232164034", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9c3de11-538a-4e00-8d30-916ea1bdc94f"}], "security_groups": [{"name": "tempest-securitygroup--453670698"}], "key_name": "tempest-keypair-1003450538", "user_data": "}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:37.562688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] validate_networks() for None {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:49:37.909536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] validate_networks() for [('c9c3de11-538a-4e00-8d30-916ea1bdc94f', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:49:38.208553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:49:38.208978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:49:38.209446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:49:38.209847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:49:38.210436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:49:38.222052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.222554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.222995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.223752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.224216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.225348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.248160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Getting quotas for project 284bb8dd87ec4ad6819b97181477dce3. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:49:38.254242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Getting quotas for user ad521a5514614e87a2f67c7462f1cf35 and project 284bb8dd87ec4ad6819b97181477dce3. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:49:38.267485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:49:38.269992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:49:38.321267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b8e8e85-d969-47ab-a69b-8f0cbb5a49f0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.910767 Aug 24 15:49:38.327979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 212/411] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:49:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 5913 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:49:38.327979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:38.328264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:38.335485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.336077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.336524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.337238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.337768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.338364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.343611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:38.584773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:49:38.584773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:49:38.585186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:49:38.585579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:49:38.585996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:49:38.590384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:38.596238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.596963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.597568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.598496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.599107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.599813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.601786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f603573d-04f0-4c8f-99e8-a1564d86a740 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.277354 Aug 24 15:49:38.616577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 213/412] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:38 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:38.621337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:49:38.622291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:38.623086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:38.627615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Getting quotas for user 2fe5724620da46ddbefbdfd442dc8d73 and project 8fe57b34d5144e91bafb66f54169cbcf. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:49:38.632289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.633034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.633633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.635055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:38.635512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:38.635975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:38.649719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:49:38.653272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:49:38.716866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8dc76419-2d35-4d3b-b136-c0131878fd3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 3.115124 Aug 24 15:49:38.720521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 200/413] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:49:35 2022] POST /compute/v2.1/servers => generated 410 bytes in 3121 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:49:38.725467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a16e0d40-1b39-4dcf-b118-19cd309b0766 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:38.726074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a16e0d40-1b39-4dcf-b118-19cd309b0766 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:38.834410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a16e0d40-1b39-4dcf-b118-19cd309b0766 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:38.844308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a16e0d40-1b39-4dcf-b118-19cd309b0766 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1218 microversion: 2.1 time: 0.122606 Aug 24 15:49:38.860207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 201/414] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:38 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:38.865781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:38.867063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6c8e3276-d38e-4192-ae6a-724750498051 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:38.867708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6c8e3276-d38e-4192-ae6a-724750498051 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:38.878246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:38.879765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:38.880955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-41c2438b-4fbf-4e7e-9735-59ab76587b6e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1724 microversion: 2.20 time: 0.263269 Aug 24 15:49:38.885311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 214/415] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:38.924684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6c8e3276-d38e-4192-ae6a-724750498051 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:38.933144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6c8e3276-d38e-4192-ae6a-724750498051 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1249 microversion: 2.1 time: 0.071680 Aug 24 15:49:38.933826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 202/416] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:39.624518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:39.625224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:39.633023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.633581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.634142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.635045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.635578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.636268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.776973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:39.785135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-23fd1ad2-da7f-433b-8d72-5d715437e00b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.165063 Aug 24 15:49:39.785695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 215/417] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:39 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:39.866297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:39.866925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:39.873761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.874243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.874671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.875353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.875830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.876247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.908584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:39.909121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:39.915255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.916402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.916833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.917543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.917998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.918426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.939140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:39.947621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9d0687a1-2f58-43fd-bccf-4a9f53f16f61 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1278 microversion: 2.1 time: 0.085358 Aug 24 15:49:39.949880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 203/418] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:39 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:39.954864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:39.955094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:39.960948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.961425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.961869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:39.963114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:39.964114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:39.964543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:40.043119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:40.051425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d02f021e-5592-476f-a3d9-ec30999245c2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1253 microversion: 2.1 time: 0.100508 Aug 24 15:49:40.052299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 204/419] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1253 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:40.074565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:40.082828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:40.084423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:40.085657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6a49d807-28eb-4680-abd7-51782d442031 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1724 microversion: 2.20 time: 0.181041 Aug 24 15:49:40.086268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 216/420] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:40.399463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-04c68968-3deb-407a-abcf-daa71d332c57 req-e6842610-0279-4a8e-98cb-460f021444a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "name": "network-vif-unplugged", "status": "completed", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:40.411156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-04c68968-3deb-407a-abcf-daa71d332c57 req-e6842610-0279-4a8e-98cb-460f021444a2 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:40.411156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-04c68968-3deb-407a-abcf-daa71d332c57 req-e6842610-0279-4a8e-98cb-460f021444a2 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:40.411486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-04c68968-3deb-407a-abcf-daa71d332c57 req-e6842610-0279-4a8e-98cb-460f021444a2 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:40.423320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-04c68968-3deb-407a-abcf-daa71d332c57 req-e6842610-0279-4a8e-98cb-460f021444a2 service nova] Creating event network-vif-unplugged:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 15:49:40.428376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-04c68968-3deb-407a-abcf-daa71d332c57 req-e6842610-0279-4a8e-98cb-460f021444a2 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032620 Aug 24 15:49:40.429138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 205/421] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:49:40.807481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:40.808020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:40.814427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:40.814904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:40.815332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:40.816042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:40.816493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:40.816914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:40.950807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:40.959026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-517c7d29-8c21-4855-8220-9a56d4d97ad7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.156227 Aug 24 15:49:40.959594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 217/422] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:40 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:40.971136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:40.971953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:40.978774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:40.979323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:40.979846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:40.980601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:40.981142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:40.981629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:41.048152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:41.055646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bd7cbdae-4a56-4143-9632-1bc6212b00dc tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1278 microversion: 2.1 time: 0.089081 Aug 24 15:49:41.056206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 206/423] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:40 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:41.072893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:41.073496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:41.079467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:41.079998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:41.080437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:41.081131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:41.081590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:41.082016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:41.111273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:41.111906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:41.117954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:41.118446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:41.118884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:41.119652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:41.120120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:41.120547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:41.145771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:41.154521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c064910d-3b71-4617-bd4f-91c40b192b5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1253 microversion: 2.1 time: 0.085877 Aug 24 15:49:41.155102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 218/424] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:41.253865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:41.262134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:41.263657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:41.264807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-06f9b69e-00a3-4cf3-bc57-170a485fbefd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1724 microversion: 2.20 time: 0.157447 Aug 24 15:49:41.265355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 207/425] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:41.990317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:41.990932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:41.997968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:41.998455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:41.998905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:41.999581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.000075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.000500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.077344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:42.078187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:42.085165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.085713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.086216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.086984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.087509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.088202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.158866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:42.162081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:42.167374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ee37b7ed-b957-44fc-89ee-b216f490c554 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1278 microversion: 2.1 time: 0.093867 Aug 24 15:49:42.168302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 208/426] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:42 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:42.171250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bce06321-9288-449d-9f3b-a9368bd40aa9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.184754 Aug 24 15:49:42.171854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 219/427] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:41 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:42.175360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:42.175996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:42.182522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.183081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.183520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.184240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.184696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.185121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.252225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:42.259826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4479dc7e-9db2-4edc-9f2f-b6dcd730f70c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1253 microversion: 2.1 time: 0.088078 Aug 24 15:49:42.260369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 209/428] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1253 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:42.287872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:42.288483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:42.297691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.298855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.300377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.301886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:42.302441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:42.302952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:42.449930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:42.458740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:42.460425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:42.461705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad8cd929-d5cf-4ce1-a7d4-85a8aaeae99c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1724 microversion: 2.20 time: 0.177889 Aug 24 15:49:42.463141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 220/429] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:43.189200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:43.190023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:43.194190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:43.194922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:43.197007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.197829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.198837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.199988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.200460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.200890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.202501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.203086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.203780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.204964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.205438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.205905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.453279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:43.461959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-35d6f02b-6861-448d-a4fc-6299fac1a769 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.272579 Aug 24 15:49:43.463405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 221/430] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:43 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:43.472989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:43.483769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:43.485081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:43.485669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-db47c7b3-c6a8-4094-9dd7-f0a6df4b42da tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.300663 Aug 24 15:49:43.486566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 210/431] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:43 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:43.494068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:43.496342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:43.497858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.499483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.500308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.501908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.502731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.503470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.510006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.510516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.511083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.513496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.514040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.514523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.655128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:43.663031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-17e595e9-f179-4368-b7ba-1051bb38e782 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1309 microversion: 2.1 time: 0.186410 Aug 24 15:49:43.663610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 222/432] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1309 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:43.687855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:43.696278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:43.698062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:43.699234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2c70a78e-9717-41f0-8d50-e27b28ad5a2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1727 microversion: 2.20 time: 0.211438 Aug 24 15:49:43.699898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 211/433] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:43.724430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bf2cad1-46f5-4539-906e-0cbf01153ae7"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:43.727174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:43.735877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.736367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.736873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.737570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.737953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.738375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.779840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb94f8de-99c4-4e4c-887a-c79646c3f706", "device": "/dev/sdb"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:43.784057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:43.790078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.790568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.791092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.792128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:43.792594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:43.793147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:43.808038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:44.131860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a3958f5f-c43b-48cc-94a8-3a92dc25eb21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.413793 Aug 24 15:49:44.132640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 223/434] 10.222.0.102 () {62 vars in 1369 bytes} [Wed Aug 24 15:49:43 2022] POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:49:44.210189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-85ca3fa4-b8e2-4616-813d-e742c90bc087 req-5fb7bace-1180-446f-86b0-7dc4543361e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02917f3d-3a55-4b46-898d-8d1b0db84f2f", "tag": "a3018018-88da-433d-bd29-3679d60b8b01"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:44.244451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-85ca3fa4-b8e2-4616-813d-e742c90bc087 req-5fb7bace-1180-446f-86b0-7dc4543361e9 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.247264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-85ca3fa4-b8e2-4616-813d-e742c90bc087 req-5fb7bace-1180-446f-86b0-7dc4543361e9 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.247817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-85ca3fa4-b8e2-4616-813d-e742c90bc087 req-5fb7bace-1180-446f-86b0-7dc4543361e9 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.269472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-85ca3fa4-b8e2-4616-813d-e742c90bc087 req-5fb7bace-1180-446f-86b0-7dc4543361e9 service nova] Creating event network-changed:a3018018-88da-433d-bd29-3679d60b8b01 for instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f on hv-cinder-84932 Aug 24 15:49:44.275020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-85ca3fa4-b8e2-4616-813d-e742c90bc087 req-5fb7bace-1180-446f-86b0-7dc4543361e9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069434 Aug 24 15:49:44.276070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 224/435] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:44.319245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:44.319676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:44.327928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.328819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.329438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.330354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.331273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.331936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.355812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ab094275-e73e-4429-99e4-975d35820c5b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "POST /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581114 Aug 24 15:49:44.357169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 212/436] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:49:43 2022] POST /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:44.393408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132517) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:49:44.476588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c79de432-0bf7-4291-a6ab-caf5d90d52f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/action" status: 202 len: 0 microversion: 2.20 time: 0.161795 Aug 24 15:49:44.481003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 225/437] 10.222.0.102 () {62 vars in 1324 bytes} [Wed Aug 24 15:49:44 2022] POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:49:44.487399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:44.492141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:44.492925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:44.495080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:44.500760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.501265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.501701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.503374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.504046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.504678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.518117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.520158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.520837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.521851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.522532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.523600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.754502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:44.768225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:44.769792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:44.771003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9c5c340-7fc8-495a-951f-fc359c15024d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1753 microversion: 2.20 time: 0.288602 Aug 24 15:49:44.771571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 213/438] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1753 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:44.788426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:44.797566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:44.815465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.821771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.822944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.823961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.824435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.824867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.826340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:44.828908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:44.841288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c5faa237-6536-4c56-8b1b-2147f6cec0f1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.358036 Aug 24 15:49:44.842455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 226/439] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:44 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:44.850524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:44.851767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:44.863777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.864523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.865422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.867136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:44.867873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:44.868499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:44.957802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:44.968141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f67dea3f-13a6-4375-9667-3c15cc226d9d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1307 microversion: 2.1 time: 0.123946 Aug 24 15:49:44.985878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 227/440] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:45.022514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:45.031797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b72b050-11ed-40a1-8f3d-36db61aaf849 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.259119 Aug 24 15:49:45.032965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 214/441] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:44 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:45.801853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:45.803151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:45.815793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:45.816921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:45.817890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:45.818844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:45.820193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:45.820725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:45.862932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:45.864172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:45.871940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:45.872670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:45.873287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:45.874150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:45.874751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:45.875328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:46.018252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:46.028444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:46.030114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:46.031473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9ec1c849-20c6-4602-a5d8-7ea009f579d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1753 microversion: 2.20 time: 0.235420 Aug 24 15:49:46.032450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 228/442] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:46.037330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:46.037938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:46.045302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:46.045999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:46.046615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:46.047470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:46.048123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:46.048646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:46.058768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:46.068554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9406af77-a9f6-4bb3-a397-a137508f3697 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.209292 Aug 24 15:49:46.069136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 215/443] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:45 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:46.076316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:46.078288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:46.086608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:46.087156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:46.087543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:46.088355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:46.088901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:46.089336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:46.273181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:46.282478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-97630fb0-9d4a-4833-a9f1-55a38f6062c3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.248435 Aug 24 15:49:46.294689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:46.296671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 229/444] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:46.302888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e40f5647-cedb-4cff-962a-dc7df85e5977 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.232539 Aug 24 15:49:46.303449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 216/445] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:46 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:46.309431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-8ac4e744-45a0-420a-b847-f810783fa590 req-7dd5bc78-78e1-45e9-947a-54b356dbf3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:46.318686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-8ac4e744-45a0-420a-b847-f810783fa590 req-7dd5bc78-78e1-45e9-947a-54b356dbf3b1 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:46.319166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-8ac4e744-45a0-420a-b847-f810783fa590 req-7dd5bc78-78e1-45e9-947a-54b356dbf3b1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:46.319620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-8ac4e744-45a0-420a-b847-f810783fa590 req-7dd5bc78-78e1-45e9-947a-54b356dbf3b1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:46.337009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-8ac4e744-45a0-420a-b847-f810783fa590 req-7dd5bc78-78e1-45e9-947a-54b356dbf3b1 service nova] Creating event network-changed:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 15:49:46.342565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-8ac4e744-45a0-420a-b847-f810783fa590 req-7dd5bc78-78e1-45e9-947a-54b356dbf3b1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037031 Aug 24 15:49:46.343174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 230/446] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:47.056826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:47.057519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:47.060053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:47.065752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.066357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.066860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.067660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.068200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.068696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.092079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:47.092788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:47.100014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.100507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.100940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.102001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.102660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.103245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.366724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:47.372459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:47.380972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-12fa562c-503a-4eb0-9b86-f6112779cedc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.289964 Aug 24 15:49:47.381633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 231/447] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:47 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:47.383418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:47.386328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:47.388335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e1eb03c2-18d9-4ca9-bd1e-f188ca1cee9a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1753 microversion: 2.20 time: 0.335759 Aug 24 15:49:47.389556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 217/448] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1753 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:47.407940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:47.409092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:47.410034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:47.410843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:47.421053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.421787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.422411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.423288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.423921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.424040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.424460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.424757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.424891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.426114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:47.426602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:47.427211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:47.622263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:47.647217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:47.651584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb486214-345f-4ebd-ab33-cb6ccdac494f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.253392 Aug 24 15:49:47.652243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 218/449] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:47 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:47.657219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e8702cbe-09c3-45de-8f8c-fc799cf57b93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.259456 Aug 24 15:49:47.658011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 232/450] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:48.403416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:48.405065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:48.417923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:48.418699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:48.421296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:48.423338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.424269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:48.427076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.427854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.428688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.431471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.432770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.435823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.441124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.441808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.442863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.446123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.446123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.609983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:48.682121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:48.690918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9032c4e2-c99b-44fb-bdd6-213249c4981c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.292198 Aug 24 15:49:48.691725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 219/451] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:48 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:48.704550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:48.712751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:48.713884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:48.714076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:48.715507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:48.716702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1d024e15-bf51-44f1-bbad-c69c87a283c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.304397 Aug 24 15:49:48.717261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 233/452] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:48.720126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.720621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.721063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.721773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.722233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.722663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.731894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:48.732513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:48.738596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.739091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.739531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.740254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:48.740714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:48.741140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:48.925781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:48.929107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:48.929250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=14 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:48.935456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fb483921-db89-4d47-9883-1d67121bfb9f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.226744 Aug 24 15:49:48.936065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 220/453] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:48 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:48.938000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71c8ccbd-6fd9-4166-afcc-e223fe91199e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.210440 Aug 24 15:49:48.938694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 234/454] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:49.713666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:49.714316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:49.720856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.721347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.721788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.722494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.722952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.723379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.739858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:49.740689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:49.743031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:49.748760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.749258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.749696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.750406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.750862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.751297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.935489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:49.940454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:49.944030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e770261e-1082-44a2-bc94-5de8618d89ba tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.234813 Aug 24 15:49:49.944604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 221/455] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:49 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:49.950707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:49.952284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:49.954309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-57e70137-f70b-48a5-8217-8940d4633cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.217752 Aug 24 15:49:49.954537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 235/456] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:49.958253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:49.958928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:49.959030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:49.959567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:49.966770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.966952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.967264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.967646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.967770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.968288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.968426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.968887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.969229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:49.969328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:49.969845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:49.970360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:50.171300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:50.174589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:50.179152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2c5cedcd-5418-4404-9808-ea180c97c606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.223631 Aug 24 15:49:50.179914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 236/457] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:50.183081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8a1062b5-2035-4e10-947b-29ce3f33f6d9 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.228954 Aug 24 15:49:50.183728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 222/458] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:49 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:50.981586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:50.982202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:50.982653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:50.983270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:50.988858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:50.989351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:50.989637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:50.989789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:50.990119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:50.990498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:50.990594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:50.990962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:50.991230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:50.991385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:50.991713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:50.992139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:51.189400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:51.193276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:51.200983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:51.202483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9c412faa-c6f2-44f3-833e-a6af7f0bf08d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.224235 Aug 24 15:49:51.202629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:51.203063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 223/459] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:50 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:51.203826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-511af1e6-a68b-4984-85a5-9010acba4337 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.227313 Aug 24 15:49:51.204323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 237/460] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:51.212216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:51.212216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:51.212465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:51.212465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:51.215259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:51.215803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:51.216245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:51.216948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:51.217404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:51.217830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:51.218519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:51.219006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:51.219435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:51.220243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:51.220689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:51.221296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:51.421419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:51.424777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:51.429334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-15efdfb2-f6ee-4f37-9285-c6c3e5699842 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.225288 Aug 24 15:49:51.430048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 224/461] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:51.432380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6533a015-189d-4a94-9021-09cd39262d86 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.227091 Aug 24 15:49:51.432932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 238/462] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:51 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:52.223923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:52.225183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:52.231693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:52.232308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:52.232661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.233152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.233582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.234283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.234732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.235153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.239000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.239587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.240056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.240769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.241228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.241657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.439999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:52.450910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:52.451115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f86fffe6-6c2d-4e14-a5dc-50d83da3820f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.231132 Aug 24 15:49:52.454384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 225/463] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:52 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:52.459049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:52.465209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:52.465964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:52.467555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:52.468862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7c67db2-718b-4b93-a563-1ee25e10b0f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.242304 Aug 24 15:49:52.469400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 239/464] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:52.473071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.474169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.474760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.475479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.475982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.476450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.490257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:52.490888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:52.497820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.498558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.499002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.499742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:52.500204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:52.500632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:52.684307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:52.692678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e0aba63c-eacb-4197-a6d8-da687a222920 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.207830 Aug 24 15:49:52.693294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:52.693585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 240/465] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:52 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:52.708326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1931c1a3-d740-4d8c-ad03-18294ac06017 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.252828 Aug 24 15:49:52.709056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 226/466] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:53.473170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:53.473787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:53.481289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.481788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.482224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.482932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.483388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.483844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.497261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:53.497953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:53.504489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.505051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.505478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.506171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.506614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.507033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.685445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:53.689165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:53.691353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:53.694054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c1ddfc11-7129-4a41-bf9c-c83d8efac1ea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.224715 Aug 24 15:49:53.694728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 241/467] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:53 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:53.701089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:53.702616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:53.703797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-548a4287-11d2-42a1-a6c3-95ec7195269b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.211125 Aug 24 15:49:53.704344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 227/468] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:53.713419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:53.714066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:53.720147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.720632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.721067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.721753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.722223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.722630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.730719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:53.731279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:53.737841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.738327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.738760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.739475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:53.739960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:53.740380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:53.940107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:53.943107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:53.948143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-840dd7ec-91b9-408f-8c32-2ac25c5381c1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.238119 Aug 24 15:49:53.948693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 242/469] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:53 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:53.964575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e092a126-3c37-4762-b911-e648061a8d0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.238050 Aug 24 15:49:53.979870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 228/470] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:54.328510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-10809da7-7775-4da7-8cea-83d864cd4d5c req-103593c2-48c9-4c44-a81b-701df1c6b5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02917f3d-3a55-4b46-898d-8d1b0db84f2f", "name": "network-vif-plugged", "status": "completed", "tag": "a3018018-88da-433d-bd29-3679d60b8b01"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:54.339679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-10809da7-7775-4da7-8cea-83d864cd4d5c req-103593c2-48c9-4c44-a81b-701df1c6b5cf service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.340178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-10809da7-7775-4da7-8cea-83d864cd4d5c req-103593c2-48c9-4c44-a81b-701df1c6b5cf service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.340632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-10809da7-7775-4da7-8cea-83d864cd4d5c req-103593c2-48c9-4c44-a81b-701df1c6b5cf service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.352166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-10809da7-7775-4da7-8cea-83d864cd4d5c req-103593c2-48c9-4c44-a81b-701df1c6b5cf service nova] Creating event network-vif-plugged:a3018018-88da-433d-bd29-3679d60b8b01 for instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f on hv-cinder-84932 Aug 24 15:49:54.357488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-10809da7-7775-4da7-8cea-83d864cd4d5c req-103593c2-48c9-4c44-a81b-701df1c6b5cf service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Aug 24 15:49:54.358135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 243/471] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:49:54.715014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:54.715623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:54.722296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.722778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.723214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.723943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.724398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.724821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.727219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:54.728119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:54.734141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.734618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.735050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.735766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.736219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.736634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.923267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:54.930803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-41b6a827-6bfd-4729-9ed5-691d9c27622f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.219592 Aug 24 15:49:54.931566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 229/472] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:54 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:54.935990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:54.938258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:54.946105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:54.948534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:54.950050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e11fcbb4-2734-4061-8f0b-30ae5e0bf2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.227495 Aug 24 15:49:54.950616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 244/473] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:54.969003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:54.969546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:54.975506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.976022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.976454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.977144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.977596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.978019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.989512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:54.990144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:54.997388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:54.998582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:54.999200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:54.999937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:55.000394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:55.001408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:55.405599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:55.410254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:55.413519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a23663d-971f-4f34-bbea-865181ce81b3 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.448343 Aug 24 15:49:55.414176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 230/474] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:54 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:55.419534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3c28ca94-97e5-4789-a1f6-0d877b5ac9f0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.433958 Aug 24 15:49:55.420233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 245/475] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:55.952216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:55.952823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:55.959283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:55.959813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:55.960253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:55.960941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:55.961393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:55.961816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:55.973703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:55.974312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:55.981252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:55.981742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:55.982188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:55.982895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:55.983353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:55.983818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:56.170010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:56.170224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:56.194739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-74296e95-d102-44c4-8e2f-56a81388c229 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.247038 Aug 24 15:49:56.195312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 231/476] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:55 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:56.212365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:56.212365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:56.212365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-47f1681e-bd38-4d64-8b2a-5c55ac51da9b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.230974 Aug 24 15:49:56.213000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 246/477] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:49:56.436577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:56.437340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:56.443271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:56.443539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:56.444245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:56.444402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:56.444677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:56.445410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:56.445865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:56.446287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:56.453393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:56.453962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:56.454395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:56.455284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:56.455539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:56.456298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:56.652591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:56.656769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:56.660813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0edc685b-4915-4200-a3bb-fc2f4f5bd6b1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.229122 Aug 24 15:49:56.661398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 247/478] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:56 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:56.666012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-997fa063-009c-4a5d-82e8-25b3ee1a46a3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.227289 Aug 24 15:49:56.667325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 232/479] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:57.224964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:57.225578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:57.225972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:57.226586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:57.231725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.232212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.232670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.233120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.233343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.233601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.233798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.234034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.234225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.234725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.235178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.235606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.433638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:57.438057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:57.442612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:57.444407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:57.445584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bbe7a75e-98b8-4157-b82d-af3e6eb26d16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.225007 Aug 24 15:49:57.448408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 248/480] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:57.449485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6f16e97-54ce-4c16-b5d8-e13e680cfaeb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.227096 Aug 24 15:49:57.456034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 233/481] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:57 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:57.683106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:57.683768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:57.687474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:57.688143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:57.689872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.690559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.691100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.691698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.692301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.692963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.694140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.694626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.695499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.696104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:57.696857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:57.697447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:57.961701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:57.969158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:57.970870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dbbeab68-38db-4d06-aa29-662380ee50a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.287253 Aug 24 15:49:57.971815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 234/482] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:57.979026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-698e6f97-85eb-4894-b886-e6d6d494fbf0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.300023 Aug 24 15:49:57.989263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 249/483] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:57 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:58.383488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-ebc2177f-3f66-4a7f-afb6-f89d15a127af req-d8a422eb-3b88-4435-860a-2625343a0c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "name": "network-vif-plugged", "status": "completed", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:49:58.399191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ebc2177f-3f66-4a7f-afb6-f89d15a127af req-d8a422eb-3b88-4435-860a-2625343a0c2b service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:58.403264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ebc2177f-3f66-4a7f-afb6-f89d15a127af req-d8a422eb-3b88-4435-860a-2625343a0c2b service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:58.403264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ebc2177f-3f66-4a7f-afb6-f89d15a127af req-d8a422eb-3b88-4435-860a-2625343a0c2b service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:58.421700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-ebc2177f-3f66-4a7f-afb6-f89d15a127af req-d8a422eb-3b88-4435-860a-2625343a0c2b service nova] Creating event network-vif-plugged:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 15:49:58.428191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-ebc2177f-3f66-4a7f-afb6-f89d15a127af req-d8a422eb-3b88-4435-860a-2625343a0c2b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049534 Aug 24 15:49:58.429179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 235/484] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:49:58.470520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:58.471891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:58.477666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:58.478410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:58.479030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:58.479942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:58.480816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:58.481776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:58.482475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:58.483103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:58.485623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:58.486115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:58.486725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:58.487444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:58.488070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:58.488507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:58.686080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:58.689361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:58.694978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:58.696511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:58.698754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ed61e3f6-7115-4a22-9ebd-6c5dbb5a25c1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.224868 Aug 24 15:49:58.698970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d7cb848c-a642-4bdf-8542-ca6e4759dfdf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.231569 Aug 24 15:49:58.699421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 236/486] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:58 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:58.699557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 250/486] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:49:58.991915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:58.992520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:58.999278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:58.999788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.000226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.000917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.001365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.001684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:59.001810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.002300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:59.008530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.009026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.009462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.010202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.010660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.011086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.203842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:59.207139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:59.211838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b467da2b-87cb-4dcd-9392-eb0246588dac tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.213793 Aug 24 15:49:59.212705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 251/487] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:58 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:49:59.215387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a256474e-ac38-4916-a0c4-78dddb854158 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.227300 Aug 24 15:49:59.215990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 237/488] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:59.720546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:59.721159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:59.721632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:49:59.722247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:49:59.727926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.728422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.728641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.728913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.729361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.729849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.730183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.730577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:49:59.730683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.731039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:49:59.731148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.731466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:49:59.957673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:59.960741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:59.967092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9c06c008-5a9e-407a-95aa-9f7d83b1e87d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.250351 Aug 24 15:49:59.967786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 252/489] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:49:59 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:49:59.970476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:59.972046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:49:59.973137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9fc117b8-ea3a-41a6-aef0-d15fe5a24ae1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.255356 Aug 24 15:49:59.973674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 238/490] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:49:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:00.234878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:00.235389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:00.235728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:00.236337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:00.241596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:00.242085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:00.242190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:00.242524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:00.242625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:00.243018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:00.243241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:00.243727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:00.243839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:00.244156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:00.244252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:00.245283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:00.440397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:00.451025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-855f53f9-ffa0-4e34-a045-08ad71e5da2f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.219929 Aug 24 15:50:00.451980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 253/491] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:00 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:00.455430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:00.465229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-56d6c1e4-44d2-4730-9565-ed9a452f17ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.233103 Aug 24 15:50:00.465809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 239/492] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:00.988089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:00.988694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:00.995557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:00.996164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:00.996599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:00.997228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:00.997714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:00.997714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:00.997906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:00.998129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.004435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:01.004923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:01.005359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.006150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:01.006831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:01.007352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.206859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:01.216644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:01.218148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8af4c3b8-9813-47f7-8a9d-98ece138e304 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.233647 Aug 24 15:50:01.219036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 254/493] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:00 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:01.226760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:01.228564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:01.230173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-81136b6f-7cbb-460e-9047-643589e01380 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.237397 Aug 24 15:50:01.230744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 240/494] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:01.473984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:01.474510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:01.480836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:01.481322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:01.481753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.482445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:01.482894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:01.483311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.485703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:01.486313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:01.492486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:01.493017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:01.493450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.494153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:01.494716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:01.495146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:01.689550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:01.693641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:01.697183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b6502e45-a36f-4e2d-a76c-389d492d96b0 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.227001 Aug 24 15:50:01.698512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 255/495] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:01 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:01.702644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f989196a-8f5e-4618-bea7-67322a02b053 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.220725 Aug 24 15:50:01.703298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 241/496] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:02.248835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:02.249438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:02.254043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:02.254653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:02.256066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.256559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.256990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.257681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.258131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.258549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.261392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.261872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.262305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.262996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.263454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.263905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.456517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:02.459782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:02.465870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-74f148eb-93df-4faf-b88d-72b6a63cdfb4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.221461 Aug 24 15:50:02.466552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 256/497] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:02 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:02.469125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:02.470473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:02.471875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-70f88515-c282-47f8-835d-262715959662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.221900 Aug 24 15:50:02.473649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 242/498] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:02.719055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:02.719774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:02.723920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:02.724545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:02.725950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.726445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.726886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.727594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.728134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.728732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.731012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.731497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.731972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.732673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:02.733179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:02.733609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:02.926245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:02.932762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:02.937733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7486f338-598d-4ef1-a0dc-b17c5c228486 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.217583 Aug 24 15:50:02.938508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 243/499] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:02.940745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-49e1d481-ee69-4a1e-82d4-d5b5e164b7ff tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.225648 Aug 24 15:50:02.941309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 257/500] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:02 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:03.487808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:03.488427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:03.495489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.496007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.496390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:03.496818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.497014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:03.497160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.497569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.497992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.502943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.503435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.503903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.504604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.505061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.505488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.701439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:03.704162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:03.710341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:03.711856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:03.712746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0659bcff-8710-44bb-bf65-d83ad26197a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1729 microversion: 2.1 time: 0.228886 Aug 24 15:50:03.713301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a44c6c8-9374-4018-b72d-bcb4ae2c1153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.222912 Aug 24 15:50:03.713561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 244/501] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:03 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:03.713812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 258/502] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:03.958387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:03.959001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:03.962008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:03.962743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:03.966214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.966711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.967199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.967896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.968357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.968785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.969770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.970321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.970846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.971603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:03.974731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:03.974731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:03.974969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:04.172151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:04.176332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:04.179833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ed691afb-adfc-4bf8-9fb8-fa4a666e8f3b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.225272 Aug 24 15:50:04.180412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 245/503] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:04.185042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9bda2b87-15bf-4f72-b35c-f76302261e40 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.227316 Aug 24 15:50:04.185719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 259/504] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:03 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:04.734869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:04.735414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:04.736389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:04.737121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:04.742007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:04.742498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:04.742936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:04.743435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:04.743649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:04.743968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:04.744119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:04.744398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:04.744573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:04.745932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:04.746429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:04.746884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:04.957880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:04.966607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:04.967827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b7932fe1-e22d-4af9-a52a-95ccb10226b7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1706 microversion: 2.1 time: 0.236779 Aug 24 15:50:04.969243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 246/505] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:04 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1706 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:04.983515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:04.985808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:04.992614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6213e199-b2cd-432e-b0c6-cd214b9c34c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.255513 Aug 24 15:50:04.994181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2e61a8c0-908c-42be-a1ac-c31a6019dc34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:04.998741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 260/506] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:05.001813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e61a8c0-908c-42be-a1ac-c31a6019dc34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.002619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e61a8c0-908c-42be-a1ac-c31a6019dc34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.003257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e61a8c0-908c-42be-a1ac-c31a6019dc34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.031430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2e61a8c0-908c-42be-a1ac-c31a6019dc34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Going to try to start instance {{(pid=132518) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 15:50:05.088324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2e61a8c0-908c-42be-a1ac-c31a6019dc34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action" status: 202 len: 0 microversion: 2.1 time: 0.098767 Aug 24 15:50:05.090144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 247/507] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:50:04 2022] POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:50:05.099889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:05.101504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:05.117267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.118924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.120315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.121713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.122484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.123277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.158170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:05.202691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:05.203397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:05.210516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.211020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.211456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.212214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.212826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.213212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.323743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:05.332475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e494d03-b707-4b0d-89c8-f3416d802e92 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.238045 Aug 24 15:50:05.333056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 261/508] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:05 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:05.337427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:05.338026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:05.344794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.345293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.345728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.346429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:05.347063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:05.347501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:05.373182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:05.381010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e53c5030-332c-4c33-9fe4-9f4871d3eff6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.183632 Aug 24 15:50:05.381721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 248/509] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:05.484486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:05.492238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-780aa1e6-577b-469f-b733-18f7883cc75f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.158173 Aug 24 15:50:05.492822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 262/510] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:05 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:06.015294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:06.015929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:06.022868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.023356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.023835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.024538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.024991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.025424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.164987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:06.174377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:06.175917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:06.177087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7eefdc0d-44c2-479b-9d3e-e53bd2a651ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.165746 Aug 24 15:50:06.177647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 249/511] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:06.354645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:06.355948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:06.362754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.363239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.363765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.364545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.365062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.365514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.402369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:06.403045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:06.409416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.409901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.410330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.411033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.411482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.411926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.546368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:06.555188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f58f45d-97c9-4b2e-a65c-159eba92a5ef tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.204884 Aug 24 15:50:06.567811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 263/512] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:06 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:06.576713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:06.577348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:06.578664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:06.583301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.583831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.584279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.584985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:06.585440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:06.585866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:06.586268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a34ccf4f-aa52-4b3a-9511-5958103a51de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.188237 Aug 24 15:50:06.586834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 250/513] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:06.721091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:06.728729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c96925e1-a062-4ff7-9fcb-08379d5441d7 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.159832 Aug 24 15:50:06.729316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 264/514] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:06 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:07.208142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:07.208678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:07.214950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.215531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.216064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.216756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.217205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.217623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.345854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:07.354538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:07.356293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:07.357605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-79aca5e1-a6b0-4d32-87d3-70a5547d0567 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.153439 Aug 24 15:50:07.358164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 251/515] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:07.583456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:07.584028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:07.591817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.592340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.592784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.593564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.595429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.595429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.608956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:07.609574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:07.615897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.616402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.616920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.617535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.618008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.618408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.824900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:07.829851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:07.833995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-03080b86-911c-4a32-8856-d9f1cc55c9f4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.254383 Aug 24 15:50:07.834518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 265/516] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:07 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:07.838963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-842771f1-c2d5-488a-87cf-34145da2117d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.233060 Aug 24 15:50:07.838963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 252/517] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:07.839835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:07.841234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:07.847165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.847682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.848203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.848912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:07.849372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:07.849799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:07.978812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:07.987502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0b3d12e-17f8-4267-b0d1-3055838e7504 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.151975 Aug 24 15:50:07.988115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 266/518] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:07 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:08.380581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:08.381215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:08.388421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.388908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.389341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.390068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.390524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.390947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.525513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:08.534116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:08.535654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:08.536806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f874d81-542c-45b7-8aed-f9bf67fae71f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.160240 Aug 24 15:50:08.537360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 253/519] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:08.858833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:08.859445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:08.866260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.866754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.867199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.867934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.868396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.868571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:08.868826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.869190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:08.876141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.876679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.877164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.877951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.878434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.878862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.079362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.083374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.087091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-32300452-82cb-426a-8b04-efbc4c56f507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.232600 Aug 24 15:50:09.087743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 267/520] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:09.091884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e25a047-001a-4d17-ac84-2bed46928aee tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.227012 Aug 24 15:50:09.092657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:09.092785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 254/521] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:08 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:09.093064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:09.098949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.099371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.099842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.100539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.100994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.101445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.233628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.241251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fd6ef526-bbb8-41e2-95b0-b58174436546 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1318 microversion: 2.1 time: 0.152563 Aug 24 15:50:09.241914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 268/522] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:09 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:09.559835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:09.560448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:09.566868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.567354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.567820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.568523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.568996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.569428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.707524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.718767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.720340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.721558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d5070037-6d1d-43af-b210-eed5d5cc5b0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.165800 Aug 24 15:50:09.722123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 255/523] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:10.110012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.110981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.117132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.117839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.117976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.118488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.118833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.119951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.121066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.121969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.125900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.126307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.126777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.127433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.127914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.128336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.333189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.336034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.341828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6a6f1e6-ff31-4af9-be62-0672f887f94a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.227680 Aug 24 15:50:10.342403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 256/524] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:10 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:10.344618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ff9af5ad-09b9-4675-aa50-c451284cfc19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1374 microversion: 2.1 time: 0.238988 Aug 24 15:50:10.355523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 269/525] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1374 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:10.355749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.355749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.355749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.355749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.356151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.356151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.356151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.356151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.484106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.492160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cd7cffd2-8823-4262-bce3-ba6fd884b7b5 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1467 microversion: 2.1 time: 0.148665 Aug 24 15:50:10.492775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 257/526] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:10 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1467 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:10.537205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.537737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.544481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.545035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.545493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.546190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.546681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.547123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.573225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:50:10.661766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4eac8acc-a45f-47ab-b5ab-f70a1f8aac3f tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "DELETE /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 204 len: 0 microversion: 2.1 time: 0.128243 Aug 24 15:50:10.662352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 270/527] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:50:10 2022] DELETE /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:50:10.671540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.672188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.678667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.679154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.679595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.680345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.680808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.681237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.745521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.746210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.752992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.753476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.753922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.754614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.755061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.755483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.845784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.853949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-181b58b9-ec2e-49d3-9e7d-3bae52df0b06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.187101 Aug 24 15:50:10.854529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 258/528] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:10 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:10.906010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.915068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.916535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.917699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7e68ead-ac84-4745-ab40-f9a89ef4cd2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.176493 Aug 24 15:50:10.918352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 271/529] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:11.362870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:11.363592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:11.365223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:11.365828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:11.369735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.370223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.370664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.371370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.372075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.372658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.372787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.373095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.373208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.373785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.374240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.374660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.780122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:11.784233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:11.788567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fba4a6ec-a296-44c2-9210-4df3911ceb0e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.429664 Aug 24 15:50:11.789143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 259/530] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:11 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:11.798992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86b49417-4c4b-4dd9-be58-e8236e8cd384 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1568 microversion: 2.1 time: 0.437440 Aug 24 15:50:11.799585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 272/531] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:11.819583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:11.820102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:11.827140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.827683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.828125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.828842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.829300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.829725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.876398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:11.877006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:11.882797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.883280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.883733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.884422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.884871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.885286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.909065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58451164-c20c-4618-9cc4-823d0976958e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093215 Aug 24 15:50:11.909788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 260/532] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 15:50:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:11.942111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:11.942901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:11.951717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.952546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.953002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.954360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.954360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.954863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.961650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:12.055725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:12.065170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9c9d11e3-7966-40b3-bb5e-a41275f07a3c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.193032 Aug 24 15:50:12.066199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 273/533] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:11 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:12.130645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:12.139581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:12.141190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:12.142416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-48ba3408-ba94-4986-b419-4b75db45abe8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.204264 Aug 24 15:50:12.143043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 261/534] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:12.810054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:12.811250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:12.819731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:12.820298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:12.820800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:12.821586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:12.828368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:12.828812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:12.862461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-cbe23dcf-f6c6-4121-9996-b0e477c92773 req-74180bd0-f8cc-4adf-a070-2868fa87d593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:12.873072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cbe23dcf-f6c6-4121-9996-b0e477c92773 req-74180bd0-f8cc-4adf-a070-2868fa87d593 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:12.873560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cbe23dcf-f6c6-4121-9996-b0e477c92773 req-74180bd0-f8cc-4adf-a070-2868fa87d593 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:12.873996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cbe23dcf-f6c6-4121-9996-b0e477c92773 req-74180bd0-f8cc-4adf-a070-2868fa87d593 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:12.886346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-cbe23dcf-f6c6-4121-9996-b0e477c92773 req-74180bd0-f8cc-4adf-a070-2868fa87d593 service nova] Creating event network-changed:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 15:50:12.892480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-cbe23dcf-f6c6-4121-9996-b0e477c92773 req-74180bd0-f8cc-4adf-a070-2868fa87d593 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034026 Aug 24 15:50:12.896003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 262/535] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:12.973061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:12.982262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3904e96c-244b-4d35-aca2-2d5a9e0d99dd tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.176329 Aug 24 15:50:12.982858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 274/536] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:12 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:13.086936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:13.087658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:13.094105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:13.094624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:13.095105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:13.095886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:13.096388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:13.096853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:13.165870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:13.166482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:13.172678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:13.173174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:13.173614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:13.174318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:13.174770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:13.175196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:13.281865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:13.289698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5587209d-dc0e-4941-a9b5-34e9e3a64305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.206982 Aug 24 15:50:13.290474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 263/537] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:13 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:13.348504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:13.357534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:13.359229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:13.360454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f0f70f9-afc6-4a4c-9811-a8c8b524af59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1755 microversion: 2.20 time: 0.198527 Aug 24 15:50:13.361015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 275/538] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:13.379325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:13.379852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:13.385781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:13.386273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:13.386711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:13.388010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:13.388469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:13.388891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:13.413808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b76b6504-c04b-4434-b84f-2ca38bd8bdb3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/ips" status: 200 len: 149 microversion: 2.1 time: 0.038278 Aug 24 15:50:13.414649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 264/539] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:50:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:14.008168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:14.009003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:14.015717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.016933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.017299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.018093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.018507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.020513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.036973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:14.180731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:14.195398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-014b0e80-f35e-43a5-aa57-ac9e5a953e14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.192558 Aug 24 15:50:14.196275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 276/540] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:14 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:14.310877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:14.311485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:14.317903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.318388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.318825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.319517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.319997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.320422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.387022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:14.388718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:14.394741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.395243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.395728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.396415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.396875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.397305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.460669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:14.471529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-49796f19-29db-48d3-b3f4-d0a9e4c0ce06 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.164856 Aug 24 15:50:14.472464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 265/541] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:14 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:14.591048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:14.602342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:14.604017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:14.605222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-217597b6-c868-4188-bd9b-8f8156e19fce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.222092 Aug 24 15:50:14.605763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 277/542] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:14.874922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a264c788-5cff-4354-b22c-9a58b4e7f283"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:14.877376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:14.883329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.883870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.884303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:14.884992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:14.885444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:14.885866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.220324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:15.221010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:15.227730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.228217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.228644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.229331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.229780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.230196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.362653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:15.370867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9453d4a7-7f88-446b-8e90-15b282f87178 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.154447 Aug 24 15:50:15.371424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 278/543] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:15 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:15.493939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:15.494444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:15.501583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.502076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.502517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.503222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.503712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.504148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.637569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:15.645668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54164484-2252-442d-897b-0ee4b6057305 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.155787 Aug 24 15:50:15.646220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 279/544] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:15 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:15.650571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:15.651172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:15.657646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.658132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.658563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.659248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.659733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.660168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.794511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:15.803075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:15.804619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:15.805765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d5a6f20-08c6-4d76-abf4-31701a2f2e5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.158643 Aug 24 15:50:15.806314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 280/545] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:16.392467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:16.393084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:16.399469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.399980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.400411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.401098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.401551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.401972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.532368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:16.541065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0b40aaf5-5222-4e7b-bea4-c3fb6ebafc24 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.153074 Aug 24 15:50:16.541713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 281/546] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:16 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:16.666399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:16.667006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:16.669384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:16.675082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.675560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.676018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.676703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.677151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.677579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.814081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:16.822206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de53e893-8f68-432c-95b2-8874a2c5704c tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.159615 Aug 24 15:50:16.823057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 282/547] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:16 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:16.832745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:16.832745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:16.836421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.837015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.837533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.838247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.838690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.839114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.983083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:16.991796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:16.993304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:16.994459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d0b3b69-e389-4123-bc8d-b4fb69936d33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.170264 Aug 24 15:50:16.995049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 283/548] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:17.565475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:17.566139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:17.572437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.572914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.573345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.574302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.575580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.576029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.706115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:17.714203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a12e6d1a-2678-433e-8428-08404cff4e45 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.152641 Aug 24 15:50:17.714764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 284/549] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:17 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:17.844700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:17.845225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:17.851207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.851769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.852204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.852892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.853346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.853776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.997321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:18.006999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6152a1b4-016f-4f32-84b0-b6af580f2592 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.166159 Aug 24 15:50:18.007593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 285/550] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:17 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:18.019156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:18.020050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:18.031433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.032490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.033264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.034462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.035427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.036204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.197024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:18.206499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:18.208076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:18.209270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b066dc6b-dbcc-41d8-b285-484cbb41e53b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.194440 Aug 24 15:50:18.209839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 286/551] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:18.737857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:18.739340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:18.746447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.747361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.748080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.749026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.749762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.750420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.818901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d53c8e42-1836-448f-a6bc-1c25c71ea7ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.947273 Aug 24 15:50:18.822606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 266/552] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:50:14 2022] POST /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 194 bytes in 3953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:19.040611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.042101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.050796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:19.054325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.055172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.055856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.057492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.058155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.060210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.076496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:19.087322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4ead488b-a8a2-4bbe-a313-1c7453d1766a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.353698 Aug 24 15:50:19.089424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 287/553] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:18 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:19.233657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.234268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.240624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.241144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.241582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.242282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.242739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.243375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.287734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:19.297817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b5f7cfb3-72bc-4775-93d0-583da87be161 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1473 microversion: 2.1 time: 0.267426 Aug 24 15:50:19.298843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 267/554] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:19 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1473 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:19.520575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:19.530728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:19.532990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:19.535570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ba617347-55cb-404c-93e3-3405d17c3a2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.304834 Aug 24 15:50:19.537000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 288/555] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:19.599530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-665e7685-c8c0-4b1f-99c6-1bb14e9a2aba req-cdd6d681-e3b3-43da-947a-2a09dcbd1493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02917f3d-3a55-4b46-898d-8d1b0db84f2f", "name": "network-vif-deleted", "tag": "a3018018-88da-433d-bd29-3679d60b8b01"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:19.613375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-665e7685-c8c0-4b1f-99c6-1bb14e9a2aba req-cdd6d681-e3b3-43da-947a-2a09dcbd1493 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.614024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-665e7685-c8c0-4b1f-99c6-1bb14e9a2aba req-cdd6d681-e3b3-43da-947a-2a09dcbd1493 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.614557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-665e7685-c8c0-4b1f-99c6-1bb14e9a2aba req-cdd6d681-e3b3-43da-947a-2a09dcbd1493 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.629451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-665e7685-c8c0-4b1f-99c6-1bb14e9a2aba req-cdd6d681-e3b3-43da-947a-2a09dcbd1493 service nova] Creating event network-vif-deleted:a3018018-88da-433d-bd29-3679d60b8b01 for instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f on hv-cinder-84932 Aug 24 15:50:19.636775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-665e7685-c8c0-4b1f-99c6-1bb14e9a2aba req-cdd6d681-e3b3-43da-947a-2a09dcbd1493 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040982 Aug 24 15:50:19.637878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 268/556] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:20.111432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:20.112080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:20.118444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.118931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.119368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.120312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.120770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.121261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.263399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:20.271553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8adbb646-a5d2-413b-a8bd-694ce61c31a6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1715 microversion: 2.1 time: 0.164106 Aug 24 15:50:20.272173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 289/557] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:20 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:20.321006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:20.321703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:20.329312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.329829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.330269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.330957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.331405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.331862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.362498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.362984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.363419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.363894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lazy-loading 'fault' on Instance uuid 02917f3d-3a55-4b46-898d-8d1b0db84f2f {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:50:20.405448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:20.413201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ca469985-3e47-479b-98f2-c9bfc7736c37 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1308 microversion: 2.1 time: 0.096838 Aug 24 15:50:20.413769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 269/558] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:20 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:20.563142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:20.563707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:20.569904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.570395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.570863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.571567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.572062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.572491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.753009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:20.764770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:20.766406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:20.767701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-650088ec-88b0-4be8-b2ac-3eea13c58393 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.209082 Aug 24 15:50:20.768670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 290/559] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:21.292705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:21.293387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:21.300059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.300542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.300978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.301667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.302115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.302534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.434008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:21.435232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:21.441938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.442423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.442853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.443544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.444019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.444137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:21.444551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.452811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-48534509-953d-423c-80fd-4d713a5d3f4a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1719 microversion: 2.1 time: 0.163914 Aug 24 15:50:21.453394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 270/560] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:21 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:21.480578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.481670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.482265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.482728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lazy-loading 'fault' on Instance uuid 02917f3d-3a55-4b46-898d-8d1b0db84f2f {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:50:21.537005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad521a5514614e87a2f67c7462f1cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284bb8dd87ec4ad6819b97181477dce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:21.546026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad765a86-751b-4960-bbbe-b7008f3e97d1 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 200 len: 1308 microversion: 2.1 time: 0.115792 Aug 24 15:50:21.546603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 291/561] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:21 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:21.790461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:21.791340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:21.798263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.798742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.799180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.807470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.808150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.808594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.978704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:21.989552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:21.990843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:21.992316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1696adc6-cb43-457e-be85-4d04cef19ac6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.205689 Aug 24 15:50:21.993034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 271/562] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:22.156915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:22.157673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:22.172215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.173315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.174082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.174967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.175580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.176204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.353360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:22.362552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lazy-loading 'services' on Instance uuid ec9e687d-4b89-420b-9671-a803340a82e1 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:50:22.496342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9bbea67c-d601-4654-9652-ddb43eb25e8c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "DELETE /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1/os-volume_attachments/bb94f8de-99c4-4e4c-887a-c79646c3f706" status: 202 len: 0 microversion: 2.1 time: 0.344716 Aug 24 15:50:22.498723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 292/563] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:50:22 2022] DELETE /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1/os-volume_attachments/bb94f8de-99c4-4e4c-887a-c79646c3f706 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:50:22.566492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:22.567200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] [instance: 02917f3d-3a55-4b46-898d-8d1b0db84f2f] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:22.573716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.574629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.576078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.576786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.577244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.577676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.592947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] HTTP exception thrown: Instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f could not be found. Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Request method failure captured: Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f HTTP/1.1 Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkiKlcFVtLSKjrHxyPDbCWk3VVg04ZUYREtfx5kFwwbGagdkBfsLvuqzLpHMiBFq7VhKULhQhsNKntbtEMqxdHYJhwdT8s7Q74ubcoHfWMqY-cycVBnkGeFvloo7XzASDXNCgbh5_L7FhoUZgJ4ec-wmjzFv62qUbta3BumaGdVF32E Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 284bb8dd87ec4ad6819b97181477dce3 Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-VolumesNegativeTest-945374293 Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:50:22.594589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/284bb8dd87ec4ad6819b97181477dce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/284bb8dd87ec4ad6819b97181477dce3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_284bb8dd87ec4ad6819b97181477dce3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/284bb8dd87ec4ad6819b97181477dce3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-VolumesNegativeTest-945374293 Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 284bb8dd87ec4ad6819b97181477dce3 Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-VolumesNegativeTest-945374293 Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-VolumesNegativeTest-945374293-project Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ad521a5514614e87a2f67c7462f1cf35 Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-VolumesNegativeTest-945374293-project Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f could not be found. Aug 24 15:50:22.596191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '02917f3d-3a55-4b46-898d-8d1b0db84f2f'} Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f could not be found. Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:22.596986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f could not be found. Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f could not be found. Aug 24 15:50:22.598163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.599240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] Returning 404 to user: Instance 02917f3d-3a55-4b46-898d-8d1b0db84f2f could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:22.599240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-afd719b3-e73b-43b9-92eb-13e35e9e4289 tempest-VolumesNegativeTest-945374293 tempest-VolumesNegativeTest-945374293-project] 10.222.0.102 "GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f" status: 404 len: 111 microversion: 2.1 time: 0.033396 Aug 24 15:50:22.599240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 272/564] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:22 2022] GET /compute/v2.1/servers/02917f3d-3a55-4b46-898d-8d1b0db84f2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:23.018383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:23.020086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:23.029027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:23.030500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:23.031046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:23.032000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:23.032534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:23.033060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:23.220882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:23.233272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:23.235495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:23.237026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1c0268d2-13e5-4f58-966b-d9b98c7784f4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.224922 Aug 24 15:50:23.249190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 293/565] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:24.088005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:50:24.088580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 15:50:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:50:24.262466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:24.263234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:24.270422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:24.271055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:24.271583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:24.272384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:24.272917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:24.273424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:24.429133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:24.439726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:24.441297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:24.442692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-02335bda-e2e9-4440-b67c-c99fa0acb484 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.184109 Aug 24 15:50:24.443296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 273/566] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:25.468880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:25.469559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:25.478719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:25.479418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:25.480142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:25.482409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:25.483176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:25.483882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:25.645447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:25.654599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:25.656150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:25.657307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ebcbb3ae-7ec7-4151-bc12-1439a6e8f7f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.192461 Aug 24 15:50:25.657854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 294/567] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:26.682194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:26.683700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:26.692038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:26.692768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:26.693551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:26.694460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:26.695148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:26.695767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:26.896681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:26.904664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:26.906340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:26.907667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f70c1077-5964-4466-9456-cafb9f89f408 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.229386 Aug 24 15:50:26.909607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 274/568] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:27.944146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:27.944846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:27.956404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:27.956907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:27.957351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:27.958068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:27.958525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:27.958943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:28.156697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:28.166079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:28.167895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:28.170348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98a019e6-f671-4dd6-8307-2db2880b9d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.241416 Aug 24 15:50:28.181323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 295/569] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:29.195353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:29.196346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:29.203393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:29.203921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:29.204361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:29.205169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:29.205560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:29.206286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:29.356831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:29.366557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:29.368244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:29.369446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-95591e09-8bfc-4eba-967d-3173a3d70701 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.179307 Aug 24 15:50:29.370013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 275/570] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:30.393399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:30.394016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:30.400934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:30.401420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:30.401876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:30.402596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:30.403049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:30.403470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:30.542328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:30.551134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:30.552653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:30.553800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3d9e4eca-3828-4b86-b08d-5d2e6eeaa29b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.164295 Aug 24 15:50:30.554348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 296/571] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:31.578427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:31.579061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:31.585841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:31.586336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:31.586779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:31.587490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:31.587982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:31.588414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:31.726784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:31.735720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:31.737206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:31.738351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6680961e-f2e5-493f-a48f-128add791d12 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.165061 Aug 24 15:50:31.739108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 276/572] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:32.760505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:32.761108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:32.768727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:32.769265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:32.769689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:32.770467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:32.770946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:32.771378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:32.936904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:32.955735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:32.957237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:32.958448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e8533d3c-d144-46c3-9754-ca5cb2caa1f5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.201866 Aug 24 15:50:32.963273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 297/573] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:33.983233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:33.983788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:33.990247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:33.990734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:33.991169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:33.991893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:33.992348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:33.992781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:34.131223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:34.140106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:34.141595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:34.142748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f3c534a-c0e0-4a47-9b59-7b6b06c35662 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.164407 Aug 24 15:50:34.143302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 277/574] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:35.166289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:35.166917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:35.174009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:35.174494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:35.174928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:35.175620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:35.176098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:35.176523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:35.311311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:35.319884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:35.321379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:35.322530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3cb7ed36-acb5-4a85-8f00-bd70b4a81a84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.160156 Aug 24 15:50:35.323082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 298/575] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:36.344592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:36.345191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:36.351595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:36.352107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:36.352543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:36.353230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:36.353685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:36.354106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:36.369042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:36.489327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:36.498581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:36.500144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:36.501323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-87851229-5191-4315-b6da-e6912038e2d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.160672 Aug 24 15:50:36.501877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 278/576] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:37.190137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63cd469c-9f54-4bbd-b971-be524a12addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: .version_select at 0x7fc5cca393a0>, body: {"keypair": {"name": "tempest-keypair-1330002248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaXoaxGVUBax1BbcTy2o8RUho6K8fPvSqOSYU9HuAMx6a7JPIEzVxT/UJXZjzfSx62juXjMws1+rAF7i/eTv7ESZbC8BKMWGxOAUYsKgZUUql6W1T7CSNmf9zUKC3emuw=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:37.208849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-63cd469c-9f54-4bbd-b971-be524a12addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:50:37.213387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-63cd469c-9f54-4bbd-b971-be524a12addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:50:37.239924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63cd469c-9f54-4bbd-b971-be524a12addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053453 Aug 24 15:50:37.240580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 299/577] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 15:50:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:37.526138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:37.527927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:37.541639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:37.547562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:37.548055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:37.549001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:37.549655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:37.550738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:37.706341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:37.718973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:37.721011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:37.722187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e47d1c4-e49c-4976-a51b-8b75f6647622 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.200089 Aug 24 15:50:37.722751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 279/578] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:38.633218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:38.634383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:38.643126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:38.643625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:38.644115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:38.644837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:38.645300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:38.645727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:38.673452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:50:38.749127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:38.749906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:38.756564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:38.757372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:38.758279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:38.759226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:38.759947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:38.760715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:38.769090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c71e9877-618b-471e-8752-6d41b001c5fd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "DELETE /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 204 len: 0 microversion: 2.1 time: 0.140653 Aug 24 15:50:38.770986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 300/579] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:50:38 2022] DELETE /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:50:38.781392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:38.782290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:38.789045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:38.789818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:38.790264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:38.790980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:38.791453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:38.792385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:39.042861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:39.048034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:39.055717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d3ca3806-3931-48a0-97a8-d4d7e651ea4c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1517 microversion: 2.1 time: 0.280245 Aug 24 15:50:39.056705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 301/580] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:38 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:39.058335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:39.060932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:39.062271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5997f971-0745-4630-a254-a7ad63a2956f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.320341 Aug 24 15:50:39.076527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-419732541", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "865ac09d-5307-48a3-bc8a-ec402499204e"}], "security_groups": [{"name": "tempest-securitygroup--1532775741"}], "key_name": "tempest-keypair-1330002248", "user_data": "}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:39.078607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 280/581] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:39.195346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] validate_networks() for [('865ac09d-5307-48a3-bc8a-ec402499204e', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:50:39.617468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:50:39.618593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:50:39.619095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:50:39.619478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:50:39.619934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:50:39.630272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:39.631285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:39.631738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:39.632555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:39.633305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:39.634554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:39.655845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:50:39.660403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:50:39.672508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:50:39.675059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:50:39.729284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b094ea5f-e255-436f-9e17-2b51f97b7a51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.657238 Aug 24 15:50:39.730475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 302/582] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:50:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:50:39.750720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-51a28068-53ae-4070-a2e4-4120c95fe313 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:39.752212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-51a28068-53ae-4070-a2e4-4120c95fe313 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:39.851606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-51a28068-53ae-4070-a2e4-4120c95fe313 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:39.863572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-51a28068-53ae-4070-a2e4-4120c95fe313 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1245 microversion: 2.1 time: 0.122926 Aug 24 15:50:39.864639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 281/583] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:39 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:40.084403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:40.085241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:40.086529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:40.087140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:40.096940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.097442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.098064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:40.098936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.099426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.100074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:40.106732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.107223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.107806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:40.108473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.111417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.111899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:40.323332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:40.338072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee098525-518c-40de-a6e7-4419b97db3de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1517 microversion: 2.1 time: 0.263950 Aug 24 15:50:40.339437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 303/584] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:40 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:40.357715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:40.367530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:40.369380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:40.370742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-56b9e1cc-cdd8-4d85-bed6-0ce5b1503fba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.289124 Aug 24 15:50:40.371489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 282/585] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:40.568801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-db565d3a-a894-4ad7-a1a4-507324da4061 req-1de45da9-c678-46f4-bab8-94f9fa5eb8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "name": "network-vif-plugged", "status": "completed", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:40.584582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-db565d3a-a894-4ad7-a1a4-507324da4061 req-1de45da9-c678-46f4-bab8-94f9fa5eb8f9 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.585357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-db565d3a-a894-4ad7-a1a4-507324da4061 req-1de45da9-c678-46f4-bab8-94f9fa5eb8f9 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.586849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-db565d3a-a894-4ad7-a1a4-507324da4061 req-1de45da9-c678-46f4-bab8-94f9fa5eb8f9 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:40.605725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-db565d3a-a894-4ad7-a1a4-507324da4061 req-1de45da9-c678-46f4-bab8-94f9fa5eb8f9 service nova] Creating event network-vif-plugged:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 15:50:40.615108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-db565d3a-a894-4ad7-a1a4-507324da4061 req-1de45da9-c678-46f4-bab8-94f9fa5eb8f9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051803 Aug 24 15:50:40.616795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 304/586] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:40.886324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:40.887081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:40.894014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.894751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.895412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:40.896400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:40.897075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:40.897702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:41.013761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:41.024184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-388a5100-1cb1-4c98-8cae-5ed776f11b31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1249 microversion: 2.1 time: 0.141780 Aug 24 15:50:41.025344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 283/587] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:40 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1249 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:41.360216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:41.360832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:41.367579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:41.368106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:41.368731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:41.369441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:41.370068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:41.370499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:41.400956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:41.401859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:41.409494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:41.425692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:41.426633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:41.427521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:41.428150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:41.428724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:41.596389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:41.606860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-91c813ed-5036-4656-851f-08d6f73f815c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1517 microversion: 2.1 time: 0.251471 Aug 24 15:50:41.609201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 305/588] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:41 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:41.718581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:41.740328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:41.742508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:41.745882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78fe4639-d416-4901-b7d6-16416bfafa82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.352489 Aug 24 15:50:41.747224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 284/589] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:42.048166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:42.049869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:42.056055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.056546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.057200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.058154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.058621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.059219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.155302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:42.181602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c2748505-9d47-4be8-8c3d-8c215ddae8e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1297 microversion: 2.1 time: 0.137762 Aug 24 15:50:42.186683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 306/590] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:42 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:42.630644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:42.631659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:42.640352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.641441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.642172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.643121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.644136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.644483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.744589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:42.756545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-821404b2-4f47-4de0-81dc-16223fc5e631 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1475 microversion: 2.1 time: 0.130066 Aug 24 15:50:42.769736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:42.770536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 285/591] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:42 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1475 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:42.770898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:42.780020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.780789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.781587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.782691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.783305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.783916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.793060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-26ee11b8-3a0a-4a81-bceb-fc66a53ca726 req-355397a7-6045-47a6-b5f1-b634e924fbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9e687d-4b89-420b-9671-a803340a82e1", "name": "network-vif-deleted", "tag": "1016ad9a-b7d2-482f-9b2b-97070093f65d"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:42.815582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-26ee11b8-3a0a-4a81-bceb-fc66a53ca726 req-355397a7-6045-47a6-b5f1-b634e924fbab service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:42.816247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-26ee11b8-3a0a-4a81-bceb-fc66a53ca726 req-355397a7-6045-47a6-b5f1-b634e924fbab service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:42.816815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-26ee11b8-3a0a-4a81-bceb-fc66a53ca726 req-355397a7-6045-47a6-b5f1-b634e924fbab service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:42.862482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-26ee11b8-3a0a-4a81-bceb-fc66a53ca726 req-355397a7-6045-47a6-b5f1-b634e924fbab service nova] Creating event network-vif-deleted:1016ad9a-b7d2-482f-9b2b-97070093f65d for instance ec9e687d-4b89-420b-9671-a803340a82e1 on hv-cinder-84932 Aug 24 15:50:42.877311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-26ee11b8-3a0a-4a81-bceb-fc66a53ca726 req-355397a7-6045-47a6-b5f1-b634e924fbab service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088455 Aug 24 15:50:42.878157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 286/592] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:43.004795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:43.017325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:43.020105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:43.021730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f84d5cb4-103f-4cfe-9f42-eb4cfce41f82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.256109 Aug 24 15:50:43.036160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 307/593] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:43.204231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:43.204959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:43.216276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:43.216598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:43.217040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:43.217767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:43.218222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:43.218645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:43.308608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:43.319887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91aa4520-9f22-4486-b5b1-8f6e898282f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1303 microversion: 2.1 time: 0.120747 Aug 24 15:50:43.320472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 287/594] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:43 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:43.778444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:43.779786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:43.786550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:43.787138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:43.787576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:43.788312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:43.788772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:43.789195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:43.843789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:43.844521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:43.845061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:43.845892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lazy-loading 'fault' on Instance uuid ec9e687d-4b89-420b-9671-a803340a82e1 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:50:43.919667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:43.930100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5249460d-49ae-4f3d-bbdf-d699b5c1479f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1313 microversion: 2.1 time: 0.156185 Aug 24 15:50:43.931365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 308/595] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:43 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:44.051331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:44.056041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:44.089449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:44.090211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:44.093362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:44.094320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:44.094958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:44.097246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:44.343746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:44.344496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:44.358854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:44.359362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:44.360569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:44.361836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:44.362747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:44.363331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:44.369542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:44.393662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:44.409816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:44.414393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:44.417508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-acb8d00e-082a-4e23-9603-7b2832efc9f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.370929 Aug 24 15:50:44.418308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 288/596] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:44.656012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:44.666490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63dc6017-4dcc-40b3-934b-cfa5cde293d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.328157 Aug 24 15:50:44.679219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 309/597] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:44 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:44.955769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:44.956392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:44.967506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:44.968028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:44.968685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:44.969164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:44.969607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:44.970027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:45.086312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:45.087527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:45.092041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:45.110343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lazy-loading 'fault' on Instance uuid ec9e687d-4b89-420b-9671-a803340a82e1 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:50:45.228291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:45.243392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-70177db6-ed1e-4e0f-9a9a-0076753f9564 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 200 len: 1313 microversion: 2.1 time: 0.290740 Aug 24 15:50:45.245309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 289/598] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:44 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:45.447786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:45.449586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:45.464641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:45.468625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:45.469568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:45.475820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:45.476767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:45.478022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:45.701710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:45.702306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:45.720423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:45.720929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:45.721564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:45.723242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:45.723751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:45.724347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:46.085535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:46.106305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:46.109885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:46.112063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4687ec96-8956-414c-ba72-c49cee351b71 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1811 microversion: 2.20 time: 0.671721 Aug 24 15:50:46.113028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 310/599] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1811 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:50:46.128773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-78f58785-9936-4ef9-9d2a-59f12b6c5494 req-8662f39e-cb6c-4037-b8e6-07d25f95a418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8140eb7-59b4-41da-821d-1dff940c68af", "tag": "c4bd3070-d90f-46b2-a723-c73a2b4920d0"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:46.147956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-78f58785-9936-4ef9-9d2a-59f12b6c5494 req-8662f39e-cb6c-4037-b8e6-07d25f95a418 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:46.154724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-78f58785-9936-4ef9-9d2a-59f12b6c5494 req-8662f39e-cb6c-4037-b8e6-07d25f95a418 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:46.157263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-78f58785-9936-4ef9-9d2a-59f12b6c5494 req-8662f39e-cb6c-4037-b8e6-07d25f95a418 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:46.186585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-78f58785-9936-4ef9-9d2a-59f12b6c5494 req-8662f39e-cb6c-4037-b8e6-07d25f95a418 service nova] Creating event network-changed:c4bd3070-d90f-46b2-a723-c73a2b4920d0 for instance c8140eb7-59b4-41da-821d-1dff940c68af on hv-cinder-84932 Aug 24 15:50:46.206691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-78f58785-9936-4ef9-9d2a-59f12b6c5494 req-8662f39e-cb6c-4037-b8e6-07d25f95a418 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091239 Aug 24 15:50:46.208537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 311/600] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:46.271206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:46.271804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: ec9e687d-4b89-420b-9671-a803340a82e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:46.296374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:46.297247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:46.298633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:46.300154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:46.301534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:46.302287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:46.331517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] HTTP exception thrown: Instance ec9e687d-4b89-420b-9671-a803340a82e1 could not be found. Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Request method failure captured: Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 HTTP/1.1 Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkhWhbTIcEudGeLXIQV8YsAhMUyHXLeiZ_zSUEumF1URRRM5S8zS9KxZlviKhfC1peLeOodUabfH5PpcBki9DZYRUa8gddIiUMUkAdkrJ6Mxp3InQG9pUdk25d7Q2L7kQ54eM8zX19v--7ewlrJgd190im3GzHIJftjcjkG9loFVbS8 Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: c4b9035514b74d60b49d9d7e404d3b9d Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-VolumesSnapshotTestJSON-836539461 Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:50:46.335786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/c4b9035514b74d60b49d9d7e404d3b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c4b9035514b74d60b49d9d7e404d3b9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_c4b9035514b74d60b49d9d7e404d3b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/c4b9035514b74d60b49d9d7e404d3b9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-VolumesSnapshotTestJSON-836539461 Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: c4b9035514b74d60b49d9d7e404d3b9d Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-836539461 Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-VolumesSnapshotTestJSON-836539461-project Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 127f047b72c443eab061a22b1155e053 Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-VolumesSnapshotTestJSON-836539461-project Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance ec9e687d-4b89-420b-9671-a803340a82e1 could not be found. Aug 24 15:50:46.337153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'ec9e687d-4b89-420b-9671-a803340a82e1'} Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9e687d-4b89-420b-9671-a803340a82e1 could not be found. Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:46.337934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9e687d-4b89-420b-9671-a803340a82e1 could not be found. Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9e687d-4b89-420b-9671-a803340a82e1 could not be found. Aug 24 15:50:46.339127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:50:46.341912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Returning 404 to user: Instance ec9e687d-4b89-420b-9671-a803340a82e1 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:46.342511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d4dc62fd-789d-466c-ad72-5b4eb0b5c363 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1" status: 404 len: 111 microversion: 2.1 time: 0.079712 Aug 24 15:50:46.343837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 312/601] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:46 2022] GET /compute/v2.1/servers/ec9e687d-4b89-420b-9671-a803340a82e1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:46.351219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:46.369245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9edfe28f-ee81-4ce2-90bd-01fe9dc3bc01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.671987 Aug 24 15:50:46.381234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 290/602] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:45 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:47.139995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:47.141275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:47.163403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:47.173043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:47.173617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:47.174271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:47.175371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:47.175949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:47.176383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:47.396707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:47.397264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:47.407249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:47.408039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:47.410288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:47.411293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:47.412187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:47.412817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:47.708542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:47.723982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:47.725320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:47.726434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e2438a6a-6483-420b-9208-0a8c40702331 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1798 microversion: 2.20 time: 0.592020 Aug 24 15:50:47.728721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 313/603] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 15:50:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1798 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:50:47.768842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:47.777284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e2a01448-2e56-4617-a9e8-049ea6f5571b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.384805 Aug 24 15:50:47.793126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 291/604] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:47 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:48.799762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:48.800542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:48.809046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:48.810408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:48.811184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:48.812427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:48.812835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:48.813569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:49.076050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:49.086448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ffe2af40-8162-4f83-bafe-8fe364591378 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.290832 Aug 24 15:50:49.087544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 314/605] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:48 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:50.109631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:50.110366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:50.112769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:50.113609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=56 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:50.120164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:50.120661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:50.121103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:50.121817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:50.123373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:50.123771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:50.526138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:50.535973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-33557219-54c9-4cf7-aebd-86677d70ad7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.431059 Aug 24 15:50:50.536758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 292/606] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:50 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:51.559096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:51.561023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:51.570879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:51.572283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=10 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:51.577556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:51.586522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:51.587340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:51.588455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:51.589088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:51.589666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:51.788115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:51.802549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3f6fc4b9-ed6a-43d4-aca3-eb24a5e512b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.246644 Aug 24 15:50:51.816636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 315/607] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:51 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:52.828265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:52.829086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:52.848037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:52.848659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:52.850980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:52.855123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:52.855536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:52.856019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:53.071702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:53.080783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-df386f89-1466-48d4-a289-797a1e94ace1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.260743 Aug 24 15:50:53.082171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 293/608] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:52 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:54.111937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:54.112708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:54.119851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:54.120633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:54.121297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:54.122976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:54.123830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:54.124471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:54.273231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:54.282881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90a13a5f-e1f1-4129-871f-baa6a9cc73b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.176023 Aug 24 15:50:54.297232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 316/609] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:54 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:55.306087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:55.307643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:55.316936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:55.317803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:55.318480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:55.319451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:55.320137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:55.320779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:55.507271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:55.523328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-44e83440-68cf-43d4-b47b-71c533e1ad74 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.222495 Aug 24 15:50:55.524310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 294/610] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:55 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:56.547354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:56.548620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:56.555453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:56.556154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:56.556750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:56.557610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:56.558223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:56.558818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:56.727228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:56.736003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d86f4631-9cc5-4416-9707-9dba37dc954e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.195273 Aug 24 15:50:56.740349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 317/611] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:56 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:56.876937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-263109308", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "networks": [{"uuid": "9405d680-d420-4ddb-a838-27ee48b0820e"}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:56.938189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] validate_networks() for [('9405d680-d420-4ddb-a838-27ee48b0820e', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:50:57.376160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:50:57.376900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:50:57.377382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:50:57.377798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:50:57.378216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:50:57.388444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:57.388941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:57.389521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:57.390276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:57.390738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:57.391161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:57.409781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Getting quotas for project c4b9035514b74d60b49d9d7e404d3b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:50:57.416395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Getting quotas for user 127f047b72c443eab061a22b1155e053 and project c4b9035514b74d60b49d9d7e404d3b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:50:57.428785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:50:57.431240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:50:57.486878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0da83636-4928-4478-9422-19e36c63fce7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.614724 Aug 24 15:50:57.493781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 295/612] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:50:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:50:57.499031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2f1e4fff-dc6c-44a0-8d5a-d8870ccc3dae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:57.499875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2f1e4fff-dc6c-44a0-8d5a-d8870ccc3dae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:57.573343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2f1e4fff-dc6c-44a0-8d5a-d8870ccc3dae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:57.582841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2f1e4fff-dc6c-44a0-8d5a-d8870ccc3dae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1222 microversion: 2.1 time: 0.088369 Aug 24 15:50:57.583891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 318/613] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:57.758888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:57.759585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:57.766912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:57.767512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:57.768020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:57.770005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:57.770500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:57.770904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:57.958200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:57.972894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-686bbe76-3b4f-40c6-a3e1-2a9fcbcdcf12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.219076 Aug 24 15:50:57.976466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 296/614] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:57 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:58.082000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-ec76e156-7d8d-4c2a-a077-3347360d1ef2 req-e558c8b1-8e44-4fd1-a956-8d4464bd9c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8140eb7-59b4-41da-821d-1dff940c68af", "name": "network-vif-plugged", "status": "completed", "tag": "c4bd3070-d90f-46b2-a723-c73a2b4920d0"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:58.096525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-ec76e156-7d8d-4c2a-a077-3347360d1ef2 req-e558c8b1-8e44-4fd1-a956-8d4464bd9c55 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:58.097519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-ec76e156-7d8d-4c2a-a077-3347360d1ef2 req-e558c8b1-8e44-4fd1-a956-8d4464bd9c55 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:58.098541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-ec76e156-7d8d-4c2a-a077-3347360d1ef2 req-e558c8b1-8e44-4fd1-a956-8d4464bd9c55 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:58.115387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-ec76e156-7d8d-4c2a-a077-3347360d1ef2 req-e558c8b1-8e44-4fd1-a956-8d4464bd9c55 service nova] Creating event network-vif-plugged:c4bd3070-d90f-46b2-a723-c73a2b4920d0 for instance c8140eb7-59b4-41da-821d-1dff940c68af on hv-cinder-84932 Aug 24 15:50:58.123265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-ec76e156-7d8d-4c2a-a077-3347360d1ef2 req-e558c8b1-8e44-4fd1-a956-8d4464bd9c55 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045989 Aug 24 15:50:58.124683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 319/615] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:58.603324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:58.604126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:58.612807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:58.613630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:58.614275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:58.615214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:58.615891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:58.616556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:58.646005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:58.711956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:58.720458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2639e32f-6907-457d-8a96-a1dbb25a8dc0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1274 microversion: 2.1 time: 0.120839 Aug 24 15:50:58.724054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 297/616] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:58 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:59.009102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:59.009809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:59.021893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:59.022870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:59.023507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:59.024474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:59.029909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:59.031046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:59.274683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:59.287132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a01a66cf-bf3b-42cb-8713-6afea83f3f47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.282781 Aug 24 15:50:59.287721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 320/617] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:59 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:59.746814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:59.749403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:59.757111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:59.757612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:59.758122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:59.758843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:59.759302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:59.759802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:59.929102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:59.938223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ca56442d-a2d5-4d64-b5a5-6acccf959063 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.195637 Aug 24 15:50:59.941709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 298/618] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:50:59 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:59.986876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-853f1780-05cd-4ae4-88e7-89e138ac305b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'create', calling method: .version_select at 0x7fc5cca4a430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1584410968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC41mU6+lakcMhsjIT4/lceniuBJioAnWJXe+K6ffrrh1rvAigQ70sh0Y3+E9OpHPJaISEdcggumi0OzLzQwJ6dfUNUpWAcjOdEraQoi5uqWuT1kJN1ODbgDTfqEa0Dfpg=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:00.002845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-853f1780-05cd-4ae4-88e7-89e138ac305b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Getting quotas for project e5d926b1275d40fc9b26912ea4bbca02. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:51:00.006642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-853f1780-05cd-4ae4-88e7-89e138ac305b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Getting quotas for user fb26df0d1b82462bb494bd96dba4cf63 and project e5d926b1275d40fc9b26912ea4bbca02. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:51:00.029932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-853f1780-05cd-4ae4-88e7-89e138ac305b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046811 Aug 24 15:51:00.030923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 321/619] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 15:50:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:00.151942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1004208852", "imageRef": "b5716db5-8a43-4841-8cea-92db705e4291", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1584410968", "networks": [{"uuid": "db88d51b-73b2-47a6-acf4-d6eadd005967"}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:00.210459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] validate_networks() for [('db88d51b-73b2-47a6-acf4-d6eadd005967', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:51:00.309101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:00.309799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:00.316376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.316865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.317323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:00.318206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.318650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.319230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:00.539517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:00.548554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b145c0e7-ef4e-4f9b-8ba0-3e5ce32d05d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1371 microversion: 2.1 time: 0.243322 Aug 24 15:51:00.549498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 322/620] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:00 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:00.581431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-e91a4720-1d53-4238-9266-6a85ba0f7031 req-6dece394-b6cd-43d0-be21-f280ac7d7279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68e3c94-e105-482d-916a-1e70d8b64373", "tag": "d1548f61-5ebc-49eb-937c-26c444647a7d"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:00.592382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e91a4720-1d53-4238-9266-6a85ba0f7031 req-6dece394-b6cd-43d0-be21-f280ac7d7279 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.593276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e91a4720-1d53-4238-9266-6a85ba0f7031 req-6dece394-b6cd-43d0-be21-f280ac7d7279 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.593716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e91a4720-1d53-4238-9266-6a85ba0f7031 req-6dece394-b6cd-43d0-be21-f280ac7d7279 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:00.605107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-e91a4720-1d53-4238-9266-6a85ba0f7031 req-6dece394-b6cd-43d0-be21-f280ac7d7279 service nova] Creating event network-changed:d1548f61-5ebc-49eb-937c-26c444647a7d for instance f68e3c94-e105-482d-916a-1e70d8b64373 on hv-cinder-84932 Aug 24 15:51:00.610614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-e91a4720-1d53-4238-9266-6a85ba0f7031 req-6dece394-b6cd-43d0-be21-f280ac7d7279 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032792 Aug 24 15:51:00.611208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 323/621] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:51:00.714672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:51:00.715151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:51:00.715607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:51:00.716954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:51:00.717376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:51:00.726740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.727229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.727769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:00.728506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.728966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.729450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:00.745855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Getting quotas for project e5d926b1275d40fc9b26912ea4bbca02. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:51:00.749790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Getting quotas for user fb26df0d1b82462bb494bd96dba4cf63 and project e5d926b1275d40fc9b26912ea4bbca02. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:51:00.760881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:51:00.763499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5716db5-8a43-4841-8cea-92db705e4291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:51:00.808925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-96657e61-0e52-4b60-a8cc-c3c54888d5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.660877 Aug 24 15:51:00.814896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 299/622] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:51:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:51:00.820636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4e9587f-51be-47a4-a955-cd6143f85c93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:00.821340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4e9587f-51be-47a4-a955-cd6143f85c93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:00.881227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4e9587f-51be-47a4-a955-cd6143f85c93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:00.888809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4e9587f-51be-47a4-a955-cd6143f85c93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1263 microversion: 2.1 time: 0.072163 Aug 24 15:51:00.889673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 324/623] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:00.959403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:00.959730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:00.967383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.968213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.968663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:00.969387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:00.970244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:00.970681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.110126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:01.119039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6cee3436-2b35-40a5-a6cd-cb2c466c6048 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.164395 Aug 24 15:51:01.119930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 300/624] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:00 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:01.571023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:01.571830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:01.582832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:01.583436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:01.583958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.584857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:01.585431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:01.585816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.722050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:01.729740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a2c63804-fd09-44ef-b6ef-a6fc95e20588 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1561 microversion: 2.1 time: 0.163261 Aug 24 15:51:01.730340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 325/625] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:01 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:01.750894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:01.751424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:01.757990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:01.758476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:01.758908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.759609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:01.760096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:01.760518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.841462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c5eadf0a-abe6-47f3-b64b-4abc040efe2e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094476 Aug 24 15:51:01.842370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 301/626] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 15:51:01 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:01.910030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:01.910648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:01.916701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:01.917133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:01.917569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.918281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:01.918760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:01.919829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:01.987653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:01.995614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc1a0efd-bfa0-4efc-94e3-c9411688864a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1315 microversion: 2.1 time: 0.089458 Aug 24 15:51:01.996221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 326/627] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1315 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:02.141143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:02.141765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:02.148108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:02.148874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:02.149319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:02.150045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:02.150497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:02.150927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:02.316101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:02.324833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-348ed302-1b1d-4612-868b-a06b71e39e6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.188169 Aug 24 15:51:02.326022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 302/628] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:03.022874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:03.032177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:03.054534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:03.055420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:03.055904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:03.060545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:03.061071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:03.061659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:03.137546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:03.151459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6cc7073a-d116-4d67-a02d-3d1b1613e0cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1321 microversion: 2.1 time: 0.138308 Aug 24 15:51:03.152077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 327/629] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1321 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:03.347553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:03.348206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:03.354685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:03.355176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:03.355619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:03.356377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:03.357622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:03.358025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:03.540040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:03.550340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-821f0928-9824-4154-92df-349b5cbbf448 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.207064 Aug 24 15:51:03.552231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 303/630] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:03 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:03.844042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-0ac97e10-d8a7-40f0-a838-1dff5fe465a4 req-bbd46b87-2715-4620-af8a-0f28112c53d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8140eb7-59b4-41da-821d-1dff940c68af", "tag": "c4bd3070-d90f-46b2-a723-c73a2b4920d0"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:03.891103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0ac97e10-d8a7-40f0-a838-1dff5fe465a4 req-bbd46b87-2715-4620-af8a-0f28112c53d0 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:03.891709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0ac97e10-d8a7-40f0-a838-1dff5fe465a4 req-bbd46b87-2715-4620-af8a-0f28112c53d0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:03.893277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0ac97e10-d8a7-40f0-a838-1dff5fe465a4 req-bbd46b87-2715-4620-af8a-0f28112c53d0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:03.918757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-0ac97e10-d8a7-40f0-a838-1dff5fe465a4 req-bbd46b87-2715-4620-af8a-0f28112c53d0 service nova] Creating event network-changed:c4bd3070-d90f-46b2-a723-c73a2b4920d0 for instance c8140eb7-59b4-41da-821d-1dff940c68af on hv-cinder-84932 Aug 24 15:51:03.925919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-0ac97e10-d8a7-40f0-a838-1dff5fe465a4 req-bbd46b87-2715-4620-af8a-0f28112c53d0 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086195 Aug 24 15:51:03.927060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 328/631] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:04.173917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:04.174540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:04.180674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:04.181287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:04.181728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:04.182429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:04.182892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:04.183323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:04.324780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:04.334123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b17deaa3-3847-4780-85a2-adf9c0441a31 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.164956 Aug 24 15:51:04.334799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 304/632] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:04.572396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:04.573749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:04.581738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:04.582519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:04.583171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:04.584330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:04.584970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:04.585583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:04.738054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:04.746307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f601d34c-742d-4d19-a82e-6a13b318ce97 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.177969 Aug 24 15:51:04.746990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 329/633] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:05.354456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:05.356741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:05.366271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:05.366777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:05.367407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:05.368182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:05.368650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:05.369107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:05.515550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:05.532648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-975b3530-c61a-4d68-8103-6dbd34689a3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.182085 Aug 24 15:51:05.533273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 305/634] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:05.769153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:05.770578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:05.777281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:05.777772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:05.778207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:05.779209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:05.779396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:05.780192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:05.917121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:05.926346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c453ad8b-1c24-4326-a4b2-e0deb994fbfe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.160952 Aug 24 15:51:05.930517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 330/635] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:05 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:06.554318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:06.554929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:06.561501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:06.561990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:06.562421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:06.563127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:06.563565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:06.564014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:06.705726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:06.713527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a4c4fa84-27f0-4242-843e-0bac20419bcf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.162987 Aug 24 15:51:06.714102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 306/636] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:06.948514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:06.949129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:06.956494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:06.957541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:06.957541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:06.958116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:06.958579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:06.959037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:07.111479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:07.123688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ffd87237-87dc-4785-b093-3483a6ee0800 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.178688 Aug 24 15:51:07.124289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 331/637] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:06 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:07.735908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:07.736585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:07.743666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:07.744418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:07.745016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:07.745910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:07.746526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:07.747187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:07.891519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:07.899471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3174ab91-5bac-4e44-bbc0-c60cfd252a33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.168857 Aug 24 15:51:07.900312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 307/638] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:08.205265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:08.205858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:08.217126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:08.217660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:08.218078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:08.218909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:08.219350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:08.219852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:08.223895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:08.371653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:08.384561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-af48809b-3207-49ba-99ab-0f79fb041e68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.184385 Aug 24 15:51:08.385181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 332/639] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:08 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:08.936114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:08.937677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:08.945633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:08.946205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:08.946725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:08.947597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:08.948152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:08.948607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:09.095692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:09.103658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3f02e87b-fdd8-4ac4-9631-d2eec3e2c536 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.175087 Aug 24 15:51:09.104158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 308/640] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:09.406694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:09.407322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:09.413771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:09.414249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:09.414683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:09.415369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:09.415852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:09.416275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:09.547693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:09.556402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b306fb90-c75b-4240-962a-09998d527ed2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.154043 Aug 24 15:51:09.557048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 333/641] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:09 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:10.127031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:10.128015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:10.134479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:10.134966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:10.135396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:10.136117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:10.136565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:10.136980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:10.291045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:10.298961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a05d10cc-20d9-4e2f-9584-8447b32434ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.177293 Aug 24 15:51:10.299530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 309/642] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:10.578730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:10.579458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:10.588305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:10.588877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:10.589315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:10.590105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:10.590642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:10.591582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:10.722784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:10.730660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e91b3923-d8a0-4884-91d4-21c3f703ba52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.156470 Aug 24 15:51:10.735602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 334/643] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:10 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:11.324726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:11.325848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:11.328307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=4 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:11.329034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=12 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:11.335192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:11.335961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:11.336558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:11.337427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:11.338029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:11.338617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:11.486060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:11.493870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a1f58925-40a6-46c1-9deb-e06db8f44e78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.173191 Aug 24 15:51:11.494440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 310/644] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:11.753612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:11.754138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:11.756135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=8 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:11.773846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:11.774350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:11.774784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:11.775492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:11.776012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:11.776440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:11.941319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:11.949092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c98a7e7f-1df8-437a-8afb-21d3ac78141f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.199587 Aug 24 15:51:11.949656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 335/645] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:11 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:12.514766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:12.515524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:12.521965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:12.522450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:12.522882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:12.523587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:12.524061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:12.524481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:12.663957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:12.673642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-173ebf7c-86e6-49fc-a602-97f16a36793b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.162593 Aug 24 15:51:12.674146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 311/646] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:12.971233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:12.971884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:12.978432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:12.978923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:12.979357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:12.980092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:12.980545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:12.980999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:13.120312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:13.130512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6006d4f9-9abe-490e-9cc9-f1166abed3be tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.163991 Aug 24 15:51:13.131092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 336/647] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:12 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:13.696847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:13.697737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:13.705943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:13.706533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:13.707096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:13.707930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:13.708463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:13.708965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:13.877381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:13.884979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d413065b-82eb-409b-9e43-fb330f193340 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.194068 Aug 24 15:51:13.885542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 312/648] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:14.152544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:14.153168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:14.160829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:14.161321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:14.161761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:14.162460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:14.162919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:14.163347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:14.309709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:14.318946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98e98e8d-5890-431a-af0d-2004864e9d0f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.170135 Aug 24 15:51:14.319430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 337/649] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:14 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:14.905383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:14.906000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:14.912553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:14.913034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:14.913458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:14.914145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:14.914589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:14.915008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:15.049471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:15.057059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-54f26b42-eba3-4c4f-9515-aaffdbc913a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.155581 Aug 24 15:51:15.057624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 313/650] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:15.341900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:15.342776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:15.352385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:15.352882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:15.353359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:15.354085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:15.354545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:15.354970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:15.512342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:15.522364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2bfdbdba-07ad-4d37-bacd-87ff12817c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.184659 Aug 24 15:51:15.523103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 338/651] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:15 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:16.081551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:16.082565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:16.092277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:16.093069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:16.093736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:16.094688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:16.095153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:16.095584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:16.157750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-77d0aa8d-53b2-4bd5-b592-4e725cf23dd3 req-81e87a96-fcca-4ba8-bf4f-2aa93248e5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:16.169222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-77d0aa8d-53b2-4bd5-b592-4e725cf23dd3 req-81e87a96-fcca-4ba8-bf4f-2aa93248e5e4 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:16.169813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-77d0aa8d-53b2-4bd5-b592-4e725cf23dd3 req-81e87a96-fcca-4ba8-bf4f-2aa93248e5e4 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:16.170256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-77d0aa8d-53b2-4bd5-b592-4e725cf23dd3 req-81e87a96-fcca-4ba8-bf4f-2aa93248e5e4 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:16.184351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-77d0aa8d-53b2-4bd5-b592-4e725cf23dd3 req-81e87a96-fcca-4ba8-bf4f-2aa93248e5e4 service nova] Creating event network-changed:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 15:51:16.194182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-77d0aa8d-53b2-4bd5-b592-4e725cf23dd3 req-81e87a96-fcca-4ba8-bf4f-2aa93248e5e4 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040423 Aug 24 15:51:16.195303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 339/652] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:16.241991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:16.244217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:16.251501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-df0f138b-2d94-4487-aff9-87ab7363dd1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.176418 Aug 24 15:51:16.252105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 314/653] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:16.545445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:16.545972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:16.551942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:16.552431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:16.552858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:16.553554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:16.553999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:16.554416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:16.686084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:16.693819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-376a36bc-9c47-4584-94d7-40794a5e3670 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.154308 Aug 24 15:51:16.694395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 340/654] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:16 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:17.273657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:17.274304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:17.282070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:17.282582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:17.283021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:17.283748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:17.284208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:17.284636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:17.418431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:17.428639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4b7bcd4c-ad8f-4512-94ba-a0fc913250eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.158977 Aug 24 15:51:17.429237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 315/655] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:17.714680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:17.715252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:17.717668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:17.723716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:17.724210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:17.724644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:17.725346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:17.725798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:17.726218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:17.865456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:17.873263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9787c3c5-b1e8-4e43-92ac-77822457193c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.162509 Aug 24 15:51:17.873891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 341/656] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:18.448839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:18.449454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:18.464035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:18.464536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:18.464973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:18.465680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:18.466135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:18.466561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:18.600664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:18.608713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-69c357f9-7cef-4306-9c86-7ac3f3858558 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.163265 Aug 24 15:51:18.609273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 316/657] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:18.894761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:18.895373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:18.901922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:18.902417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:18.902858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:18.903560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:18.904052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:18.904484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:19.038302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:19.046874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10487f0e-698a-433b-9b49-c05fd6b303a1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.155898 Aug 24 15:51:19.047450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 342/658] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:18 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:19.629684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:19.630385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:19.637007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:19.637490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:19.637926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:19.638620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:19.639069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:19.640026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:19.769374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:19.777288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05ba1270-b9c6-471b-aae6-d63ce3a12f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.151574 Aug 24 15:51:19.777894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 317/659] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:20.068512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:20.069127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:20.075870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:20.076366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:20.076798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:20.078279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:20.078744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:20.079207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:20.215501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:20.223233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d1196cc5-40ae-472f-a053-8f732b1a2d6d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.158567 Aug 24 15:51:20.223834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 343/660] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:20 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:20.799203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:20.799869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:20.801739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:20.807005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:20.807495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:20.807964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:20.808673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:20.809130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:20.809558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:20.942250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:20.949829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e7fba946-7ebd-4cc5-b775-5c1ae8a19bc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.155506 Aug 24 15:51:20.950400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 318/661] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:21.146014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:21.146524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:21.154201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.154699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.155829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.156541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.156998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.157473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.239189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lazy-loading 'services' on Instance uuid 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:51:21.244500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:21.245103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:21.251872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.252353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.252781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.253472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.253919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.254347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.316310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-895e165a-a804-4e1f-96e3-302177f3ee5a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-volume_attachments/e0209559-3a17-48fd-bd66-3554f5b301df" status: 202 len: 0 microversion: 2.1 time: 0.174290 Aug 24 15:51:21.316919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 344/662] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:51:21 2022] DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-volume_attachments/e0209559-3a17-48fd-bd66-3554f5b301df => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:51:21.324807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8aec088-688d-4945-8094-a0d52efe81b3"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:21.327961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:21.334742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.335262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.335755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.336537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.337223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.337867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.402399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:21.411210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eee6023b-023f-496e-83df-43a263c3fdd0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.170693 Aug 24 15:51:21.411950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 319/663] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:21 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:21.972289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:21.972948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:21.979432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.979948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.980382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:21.981069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:21.981520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:21.981946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:22.123669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:22.133408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-59535bb9-8f7a-4e18-ac69-42db87fa3539 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.165034 Aug 24 15:51:22.134211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 320/664] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:22.251017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f86e027-1d7d-4833-b842-50735b6f5a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932701 Aug 24 15:51:22.255733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 345/665] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:51:21 2022] POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:22.368283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-8a5247f8-e097-4d9b-a94f-13cdf4ebdd92 req-758fd6b8-4817-441b-8b70-0e31955775d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68e3c94-e105-482d-916a-1e70d8b64373", "name": "network-vif-plugged", "status": "completed", "tag": "d1548f61-5ebc-49eb-937c-26c444647a7d"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:22.379089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8a5247f8-e097-4d9b-a94f-13cdf4ebdd92 req-758fd6b8-4817-441b-8b70-0e31955775d1 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:22.379240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8a5247f8-e097-4d9b-a94f-13cdf4ebdd92 req-758fd6b8-4817-441b-8b70-0e31955775d1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:22.379558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8a5247f8-e097-4d9b-a94f-13cdf4ebdd92 req-758fd6b8-4817-441b-8b70-0e31955775d1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:22.392964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-8a5247f8-e097-4d9b-a94f-13cdf4ebdd92 req-758fd6b8-4817-441b-8b70-0e31955775d1 service nova] Creating event network-vif-plugged:d1548f61-5ebc-49eb-937c-26c444647a7d for instance f68e3c94-e105-482d-916a-1e70d8b64373 on hv-cinder-84932 Aug 24 15:51:22.399316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-8a5247f8-e097-4d9b-a94f-13cdf4ebdd92 req-758fd6b8-4817-441b-8b70-0e31955775d1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Aug 24 15:51:22.399958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 321/666] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:51:22.433992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:22.434692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:22.445749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:22.446245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:22.447148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:22.447882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:22.448339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:22.448767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:22.603434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:22.611341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ebd2ca70-7c2c-47f1-b0e2-8575530b3d70 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.182995 Aug 24 15:51:22.611946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 346/667] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:23.156408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:23.157466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:23.163931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.164414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.165209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.165790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.165973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.166395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.302604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:23.310097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7c1a9279-fe2b-44b1-85c7-1f5961ad717e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.159332 Aug 24 15:51:23.310659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 322/668] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:23.529111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-666f8b17-6bbc-4725-a287-fdf5d2fb1754 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:23.535593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f8b17-6bbc-4725-a287-fdf5d2fb1754 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.536115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f8b17-6bbc-4725-a287-fdf5d2fb1754 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.536531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f8b17-6bbc-4725-a287-fdf5d2fb1754 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.586157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:23.598894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-666f8b17-6bbc-4725-a287-fdf5d2fb1754 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Going to try to stop instance {{(pid=132517) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 15:51:23.633884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:23.634522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:23.641480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.641993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.642369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.643063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.643727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.644409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.648959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-666f8b17-6bbc-4725-a287-fdf5d2fb1754 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action" status: 202 len: 0 microversion: 2.1 time: 0.123583 Aug 24 15:51:23.652611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 347/669] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:51:23 2022] POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:51:23.657960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:23.658752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:23.664841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.665331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.665767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.666467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:23.666925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:23.667351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:23.851425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:23.855794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:23.860271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-711790eb-538b-4fda-a88a-b97e1cc19536 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.230538 Aug 24 15:51:23.860856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 323/670] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:23 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:23.864330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a5e7d332-b6da-4897-9ef4-2f6f714bc1b3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.210388 Aug 24 15:51:23.864892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 348/671] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:23 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:24.331969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:24.332588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:24.339004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.339488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.339964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:24.340662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.341125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.341552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:24.473719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:24.481282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b235e86-1549-482b-b580-b6ce15128f20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.154075 Aug 24 15:51:24.481845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 324/672] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:24.673663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-58142083-22d3-4e00-a0a5-24fd997518f6 req-04a64c25-8381-4a0d-9f42-002f8c687220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "name": "network-vif-plugged", "status": "completed", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:24.684352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-58142083-22d3-4e00-a0a5-24fd997518f6 req-04a64c25-8381-4a0d-9f42-002f8c687220 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.684839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-58142083-22d3-4e00-a0a5-24fd997518f6 req-04a64c25-8381-4a0d-9f42-002f8c687220 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.685271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-58142083-22d3-4e00-a0a5-24fd997518f6 req-04a64c25-8381-4a0d-9f42-002f8c687220 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:24.696545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-58142083-22d3-4e00-a0a5-24fd997518f6 req-04a64c25-8381-4a0d-9f42-002f8c687220 service nova] Creating event network-vif-plugged:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 15:51:24.701305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-58142083-22d3-4e00-a0a5-24fd997518f6 req-04a64c25-8381-4a0d-9f42-002f8c687220 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 Aug 24 15:51:24.701900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 349/673] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:24.882363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:24.883079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:24.886272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:24.887040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:24.889409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.890511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.890966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:24.891727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.892192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.892628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:24.893203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.893733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.894174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:24.894881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:24.895343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:24.895805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:25.090590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:25.097788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:25.099318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d5f71b1-640f-42b2-bf15-e7e9e5a2e942 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.217119 Aug 24 15:51:25.100050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 350/674] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:24 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:25.105357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bcc3ea32-fada-42ac-9928-1dc1039be546 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1322 microversion: 2.1 time: 0.226841 Aug 24 15:51:25.106066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 325/675] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:25.502369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:25.502970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:25.508875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:25.509356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:25.509786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:25.510467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:25.510913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:25.511341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:25.649200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:25.658056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fb65c2d2-33a6-4027-9fb4-706c72819495 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.159537 Aug 24 15:51:25.658726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 351/676] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:26.122517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:26.123148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:26.127394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:26.128034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:26.130532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.131068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.131462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.132195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.132649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.133072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.134643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.135128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.135567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.136286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.136750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.137180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.333819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:26.340540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:26.341479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc1fcd7d-1b5d-4868-8438-b304f022cc4d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.222889 Aug 24 15:51:26.342052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 326/677] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:26 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:26.348414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6f796629-bcbd-4108-a3dc-c84b2062f24d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1511 microversion: 2.1 time: 0.225986 Aug 24 15:51:26.348978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 352/678] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:26 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:26.369606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e894f144-a7dd-4a87-882c-c80de8e6ba7d", "device": "/dev/sdb"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:26.372120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:26.378836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.379694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.380136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.380842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.381298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.381725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.635808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05a035c4-51ea-40ba-8256-644b991dde18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "POST /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269905 Aug 24 15:51:26.636362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 327/679] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:51:26 2022] POST /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:51:26.679137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:26.679874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:26.686085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.686689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.687133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.687957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:26.688418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:26.688846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:26.825188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:26.834588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-202bb0e0-4568-4b17-be45-58634a8e303f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.159769 Aug 24 15:51:26.835538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 353/680] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:27.363576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:27.364223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:27.370384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:27.370873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:27.371344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:27.372082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:27.372541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:27.372969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:27.500873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:27.508580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c2c71be-10ff-4512-a768-3b978acc0a04 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.149949 Aug 24 15:51:27.509138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 328/681] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:27 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:27.856762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:27.857381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:27.865063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:27.865554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:27.865994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:27.866690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:27.867147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:27.867572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:28.004038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:28.011503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-18c58f1a-e8c4-4662-a2ef-dcdfdd916884 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1363 microversion: 2.1 time: 0.158583 Aug 24 15:51:28.012087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 354/682] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:28.530254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:28.530990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:28.544751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:28.545612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:28.546387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:28.547598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:28.548485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:28.549089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:28.679510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:28.687387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-110068f5-0de0-427f-bea9-72e8762e9c5c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.161026 Aug 24 15:51:28.687950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 329/683] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:28 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:29.032686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:29.033297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:29.039724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.040215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.040653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.041349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.041803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.042227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.170726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:29.178931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d765047-c9d5-4403-91c3-69ace244117b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1553 microversion: 2.1 time: 0.150177 Aug 24 15:51:29.179596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 355/684] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:29.200852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:29.201474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:29.208530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.209018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.209455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.210163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.210621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.211045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.352083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:29.354374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:29.363366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-305ba995-9985-462f-9203-63e13dbc9dcd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1553 microversion: 2.1 time: 0.166257 Aug 24 15:51:29.363976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 330/685] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:29.384492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:29.389634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:29.390560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Searching by: {'deleted': False, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02'} {{(pid=132517) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 15:51:29.397066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.397576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.398001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.398715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.399174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.399578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.488994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.multi_cell_list [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 15:51:29.586573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7ace9bf1-c884-4fb3-82bf-fbac87ba5bb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.205756 Aug 24 15:51:29.587158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 356/686] 10.222.0.102 () {58 vars in 1130 bytes} [Wed Aug 24 15:51:29 2022] GET /compute/v2.1/servers => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:29.599169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:29.599809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:29.607223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.607744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.608235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.609604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.610057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.610484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.710328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:29.711549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:29.723887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.723887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.723887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.723887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:29.724204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:29.724204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:29.745149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:29.753109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c76d82c6-c9ec-4b1d-92b5-48cd588005ac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1553 microversion: 2.1 time: 0.157948 Aug 24 15:51:29.753682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 331/687] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:29.870656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:29.879013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ae0aa834-496f-4216-9513-fb43f17d3cf9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.173508 Aug 24 15:51:29.879823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 357/688] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:29 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:30.849675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:30.852074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:30.859429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:30.859683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:30.860123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:30.860826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:30.861274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:30.861697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:30.885030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lazy-loading 'flavor' on Instance uuid c5e42f6c-3744-4979-9c73-20f918be2be6 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:51:30.911321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:30.912103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:30.918589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:30.919086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:30.919525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:30.920274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:30.920732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:30.921707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:31.053101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f924235-5e9d-42fb-8875-8f8a029aa1c6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/action" status: 200 len: 32 microversion: 2.1 time: 0.207147 Aug 24 15:51:31.057915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 332/689] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:51:30 2022] POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:51:31.058212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:31.065889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d07e85b3-27dc-43bd-8b28-c4bc0328481d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.158360 Aug 24 15:51:31.066170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:31.066455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 358/690] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:30 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:31.066896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:31.073317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:31.073809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:31.074434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:31.075148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:31.075607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:31.076097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:31.225972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:31.240615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e9a576a3-9aaf-4136-85ea-2b2d20c24995 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.179231 Aug 24 15:51:31.241683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 333/691] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:31.369917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8101a05-ef94-4465-b161-dd34588e455d"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:31.372600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:31.379298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:31.380036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:31.380480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:31.381187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:31.381647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:31.382077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:31.715415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7cf6cef-b73e-4df5-99ec-87e8dd016f69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349225 Aug 24 15:51:31.716066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 359/692] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:51:31 2022] POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:51:32.087437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:32.088104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:32.094893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:32.095383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:32.095878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:32.096588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:32.097054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:32.097480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:32.227200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:32.236606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1deb29a1-3f3f-43c1-b0b8-92ca778b42d4 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.152912 Aug 24 15:51:32.237160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 334/693] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:32 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:32.262444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:32.263147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:32.269376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:32.269868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:32.270310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:32.271008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:32.271467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:32.271923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:32.402760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:32.410896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6de1fc33-d1a2-4dec-9778-db0b117177f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153141 Aug 24 15:51:32.411476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 360/694] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:33.259170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:33.259806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:33.267459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:33.267968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:33.268402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:33.269092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:33.269542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:33.269961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:33.413109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:33.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c107949-4962-4910-9207-42e1e3ad283e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.165443 Aug 24 15:51:33.421663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 335/695] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:33 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:33.431653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:33.432347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:33.439482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:33.439991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:33.440425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:33.441114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:33.441569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:33.442107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:33.569985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:33.579047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10c91105-2ca0-4c50-9343-e23d128ba4f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151230 Aug 24 15:51:33.579612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 361/696] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:34.442523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:34.443137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:34.450679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:34.451188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:34.451652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:34.452900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:34.453764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:34.454195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:34.592960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:34.600650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:34.601262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:34.601638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-499605a3-2343-4e7c-a9ff-c63d431bf5af tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.163028 Aug 24 15:51:34.602202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 336/697] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:34 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:34.607835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:34.608385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:34.608848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:34.609549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:34.610009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:34.610439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:34.613211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:34.739541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:34.747615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-af8e5d22-0b57-4a0f-a568-1cd9a446accd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.150854 Aug 24 15:51:34.748276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 362/698] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:35.623444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:35.624589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:35.631027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:35.631508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:35.631996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:35.632692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:35.633151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:35.633579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:35.770224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:35.770734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:35.770849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:35.777317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:35.777806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:35.778246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:35.778542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1067e81a-c692-43e8-bfe4-7bf54e87ae34 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.158991 Aug 24 15:51:35.778950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:35.779113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 337/699] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:35 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:35.779784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:35.780286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:35.913670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:35.924283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1617eea3-de62-42d8-a5fd-cd19de8d17e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155983 Aug 24 15:51:35.924283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 363/700] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:36.800019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:36.800543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:36.806853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:36.807330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:36.807796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:36.808469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:36.808922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:36.809336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:36.941530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:36.943182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:36.943821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:36.949690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-89914e8a-ae13-4b09-a604-764c48f3edfe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.153680 Aug 24 15:51:36.949926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:36.950265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 338/701] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:36 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:36.950415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:36.950823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:36.951508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:36.951983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:36.952400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:37.297163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:37.305335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-17363f67-2ac4-4fe0-83d7-755b40527a92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.365817 Aug 24 15:51:37.306030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 364/702] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:37.973545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:37.974164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:37.980910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:37.981401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:37.981844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:37.982545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:37.983005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:37.983429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:38.134379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:38.143121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-050b457a-3e50-453f-9177-e3794f154b99 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.174226 Aug 24 15:51:38.143875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 339/703] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:37 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:38.326252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:38.326993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:38.335087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:38.335580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:38.336045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:38.336750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:38.337200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:38.337624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:38.480716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:38.489089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-066fddc1-c0a9-4870-95a1-c22a0c89e436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.166750 Aug 24 15:51:38.489745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 365/704] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:39.166164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:39.166766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:39.173686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:39.174312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:39.174550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:39.175240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:39.175728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:39.176149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:39.306038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:39.314177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d9e9ebab-3af8-410f-bf9d-cf8fba556120 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1683 microversion: 2.1 time: 0.151303 Aug 24 15:51:39.314747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 340/705] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:39 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:39.511321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:39.511890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:39.514149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:39.520685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:39.521315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:39.521765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:39.522476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:39.523250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:39.524069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:39.679269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:39.688506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-15e49b80-49bb-40fd-a82b-ad8e30e67e85 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.180919 Aug 24 15:51:39.689288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 366/706] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:40.336063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:40.336672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:40.343877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.344366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.346123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.346843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.347305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.347769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.475934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:40.483590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-acc3384d-75a1-40b9-ab3b-c8292e29ae31 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1660 microversion: 2.1 time: 0.151898 Aug 24 15:51:40.484180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 341/707] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:40 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1660 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:40.504243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d72c07d-5dad-4f46-91fe-f95196470f14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:40.510294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d72c07d-5dad-4f46-91fe-f95196470f14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.510782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d72c07d-5dad-4f46-91fe-f95196470f14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.511220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d72c07d-5dad-4f46-91fe-f95196470f14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.534789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d72c07d-5dad-4f46-91fe-f95196470f14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Going to try to start instance {{(pid=132517) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 15:51:40.576057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d72c07d-5dad-4f46-91fe-f95196470f14 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action" status: 202 len: 0 microversion: 2.1 time: 0.076187 Aug 24 15:51:40.576657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 367/708] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:51:40 2022] POST /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:51:40.585696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:40.586300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:40.593087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.593651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.594293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.595681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.596349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.596943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.713669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:40.714546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:40.721983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.722607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.723155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.724081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:40.724481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:40.724911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:40.729179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:40.738081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-50d62b8d-3330-4d0c-b403-986fb4090a83 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1669 microversion: 2.1 time: 0.156110 Aug 24 15:51:40.739720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 342/709] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:40 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:40.870959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:40.879329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-20449e6a-cd05-4134-a7f2-caa4f7831f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.170095 Aug 24 15:51:40.879934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 368/710] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:41.759563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:41.760362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:41.767040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:41.767534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:41.768041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:41.768744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:41.769202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:41.769624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:41.900508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:41.901126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:41.901271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:41.908309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:41.908812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:41.909257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:41.909775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f1982fd0-76b1-4ef8-ab7f-c2e67745e943 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1669 microversion: 2.1 time: 0.154025 Aug 24 15:51:41.909967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:41.910346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 343/711] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:41 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:41.910558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:41.910864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:42.042964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:42.052367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-501c3962-3474-49c1-b93d-c8741ca66bbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155687 Aug 24 15:51:42.052946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 369/712] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:42.931654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:42.932184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:42.939377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:42.939915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:42.940349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:42.941048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:42.941503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:42.941930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:43.073556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:43.074153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:43.076869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:43.081703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:43.082189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:43.082625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:43.083318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:43.083792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:43.084214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:43.085067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b2dd5d99-00df-4c36-baa6-862a80cf77a5 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1673 microversion: 2.1 time: 0.157485 Aug 24 15:51:43.085611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 344/713] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:42 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:43.215952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:43.225142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8e7d15e9-69b4-4dc0-99d9-697bfef37920 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155423 Aug 24 15:51:43.225723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 370/714] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:44.248107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:44.248711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:44.255867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:44.256347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:44.256783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:44.257465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:44.257913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:44.258329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:44.272986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:44.396740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:44.404923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-82dd975d-00a3-4fa9-8e64-6e2fa114fd41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160768 Aug 24 15:51:44.405488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 345/715] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:45.426073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:45.426664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:45.433063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:45.433540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:45.433967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:45.434657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:45.435110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:45.435530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:45.566146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:45.574235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-64989594-7129-4d51-9711-920ce920b43d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.152265 Aug 24 15:51:45.574794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 371/716] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:46.596427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:46.597027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:46.603479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:46.603986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:46.604423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:46.605113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:46.605567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:46.605993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:46.738450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:46.746640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3b8d9425-e2aa-4ee4-831b-841548295a19 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154776 Aug 24 15:51:46.747498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 346/717] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:46.777679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:46.778193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:46.784694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:46.785171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:46.785600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:46.786298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:46.786750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:46.787165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:46.816512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a67eebf5-d27a-4fb7-8c19-a95cd5e3cb84 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments/9bf2cad1-46f5-4539-906e-0cbf01153ae7" status: 200 len: 194 microversion: 2.20 time: 0.043646 Aug 24 15:51:46.817086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 372/718] 10.222.0.102 () {60 vars in 1459 bytes} [Wed Aug 24 15:51:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments/9bf2cad1-46f5-4539-906e-0cbf01153ae7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:46.886599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:46.887095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:46.894341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:46.894830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:46.895266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:46.895998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:46.896456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:46.896881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:47.020528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lazy-loading 'services' on Instance uuid 4f595382-be87-4054-8542-60e6dfeba11d {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:51:47.149497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-96895937-9ed0-437e-9270-2446bfe09321 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments/9bf2cad1-46f5-4539-906e-0cbf01153ae7" status: 202 len: 0 microversion: 2.20 time: 0.266496 Aug 24 15:51:47.150091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 347/719] 10.222.0.102 () {60 vars in 1462 bytes} [Wed Aug 24 15:51:46 2022] DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments/9bf2cad1-46f5-4539-906e-0cbf01153ae7 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:51:47.158691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:47.161008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:47.167156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:47.167670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:47.168094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:47.168784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:47.169232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:47.169651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:47.201392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4c161593-3d7c-45fa-964e-10f8c88b6373 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046779 Aug 24 15:51:47.201932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 373/720] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:47.775434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:47.776174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:47.783676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:47.784951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:47.785391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:47.786108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:47.787273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:47.788330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:47.921377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:47.930333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c0477f2f-fad9-4c38-9479-57e2dd3bd439 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159616 Aug 24 15:51:47.930907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 348/721] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:48.214311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:48.216455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:48.218791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=66 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:48.224741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:48.225339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:48.225845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:48.226634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:48.227088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:48.227505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:48.257880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4cbd6cfd-b3e5-4f38-9fc5-fbfde236675a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047420 Aug 24 15:51:48.258434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 374/722] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:48.951912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:48.952503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:48.960000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:48.960478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:48.960909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:48.961592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:48.962042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:48.962460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:49.252634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:49.260795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-80711a61-fb47-4107-811f-b84550f072f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.312745 Aug 24 15:51:49.261367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 349/723] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:49.271090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:49.273277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:49.279612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:49.280246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:49.280678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:49.281365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:49.281821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:49.282242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:49.311246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e341928-32b9-4517-a2ae-3478e85b4352 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044759 Aug 24 15:51:49.311819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 375/724] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:51:50.282773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:50.283573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:50.290028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:50.290514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:50.290953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:50.291667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:50.292128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:50.292555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:50.323589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:50.325734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:50.333190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:50.333675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:50.334101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:50.334796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:50.335245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:50.335688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:50.367694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b5dc6a5-cdc7-4e33-a250-a8353161e63a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047907 Aug 24 15:51:50.368271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 376/725] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:51:50.427415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:50.435511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9369be42-2601-4e9f-a90f-a35dd44d5655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156771 Aug 24 15:51:50.436106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 350/726] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:51:51.381661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:51.383828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:51.391046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:51.391532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:51.392485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:51.393200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:51.393662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:51.394085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:51.420099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:51.428007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-58b4bcd5-ccba-42e0-9ce6-bb728a514f7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051991 Aug 24 15:51:51.428576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 377/727] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:51.457065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:51.457666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:51.460114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=66 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:51.465745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:51.466226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:51.466658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:51.467356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:51.467836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:51.468264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:51.599453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:51.608235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ed865e61-8ee8-48d8-9655-94759d287344 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155236 Aug 24 15:51:51.608803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 351/728] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:52.441216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:52.443348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:52.450405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:52.450819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:52.451252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:52.451982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:52.452437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:52.452860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:52.482248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c49feba-3f02-4054-97e2-5312d037202b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046164 Aug 24 15:51:52.482817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 378/729] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:52.628866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:52.629465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:52.635834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:52.636316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:52.636754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:52.637438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:52.637885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:52.638306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:52.771660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:52.779962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a871e1a7-978c-4c5f-a1f0-cb773c659acd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154948 Aug 24 15:51:52.780528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 352/730] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:53.495403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:53.497527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:53.505125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:53.505611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:53.506050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:53.506746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:53.507204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:53.507655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:53.540631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-17b5c248-388f-4a5a-a30e-fe8e7e42c5a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049226 Aug 24 15:51:53.541207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 379/731] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:53.803156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:53.803731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:53.810152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:53.810639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:53.811072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:53.811790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:53.812246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:53.812673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:53.956630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:53.965171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc656075-84cd-442c-ab88-16f898a7e69a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.165934 Aug 24 15:51:53.965749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 353/732] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:54.553903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:54.556015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:54.562777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:54.563262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:54.563756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:54.564465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:54.564924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:54.565353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:54.595725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0ae44a50-18f2-489b-a965-b39f5531667b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045174 Aug 24 15:51:54.596288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 380/733] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:51:54.985613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:54.986226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:54.993656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:54.994146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:54.994580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:54.995279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:54.995760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:54.996183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:55.130682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:55.139203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-139ccdcd-826c-4644-90ab-d55e2a47e9f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157411 Aug 24 15:51:55.139797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 354/734] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:55.608278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:55.610500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:55.617082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:55.617577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:55.618018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:55.618722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:55.619181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:55.619612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:55.650068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2ccc5281-f332-4624-887e-90952e6da1dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045811 Aug 24 15:51:55.650622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 381/735] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:56.160426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:56.161037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:56.167438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:56.167960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:56.168406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:56.169100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:56.169556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:56.169984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:56.303083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:56.311286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0c8add1a-e904-4b71-a60a-aa24d48a8c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154803 Aug 24 15:51:56.311885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 355/736] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:56.663054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:56.665216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:56.671805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:56.672293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:56.672729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:56.673973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:56.674436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:56.674866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:56.705305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b8059c52-07b8-42ca-895b-9fa0047837eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045324 Aug 24 15:51:56.706317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 382/737] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:57.333927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:57.334449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:57.340892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:57.341400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:57.341844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:57.342545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:57.343003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:57.343430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:57.568231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:57.576405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-86039c38-7b16-4e0b-a42e-b557c2d4a8f2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.247222 Aug 24 15:51:57.576978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 356/738] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:57.718091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:57.720961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:57.727323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:57.727855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:57.728293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:57.728984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:57.729434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:57.729856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:57.758229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-09c62377-5ca4-4a14-bbc6-1e11f1bee187 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044077 Aug 24 15:51:57.758782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 383/739] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:58.598551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:58.599161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:58.605610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:58.606193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:58.606562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:58.607254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:58.607735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:58.608159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:58.739624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:58.747788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-96547b0b-ffb7-4b61-9018-c1d288da2b2c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153666 Aug 24 15:51:58.748362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 357/740] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:51:58.771202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:58.773350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:58.779750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:58.780227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:58.780659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:58.781340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:58.781785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:58.782200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:58.810917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a1239fc3-0aff-42fb-aeca-01ea1b90d53c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Aug 24 15:51:58.811472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 384/741] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:51:59.769488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:59.770086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:59.776463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:59.776947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:59.777376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:59.778064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:59.778513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:59.778932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:59.824175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:51:59.826565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:51:59.834836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:59.835469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:59.835814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:59.836550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:51:59.837018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:51:59.837456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:51:59.871211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8e9358b0-1215-4679-99b7-823c10d82794 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051061 Aug 24 15:51:59.871857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 385/742] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:51:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:51:59.922559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:51:59.932699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12164f1d-7464-465d-a817-01c63ed5206a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.167079 Aug 24 15:51:59.933291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 358/743] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:51:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:00.883951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:00.886106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:00.892077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:00.892566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:00.893000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:00.893704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:00.894153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:00.895165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:00.925762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b49d126-4e02-47b2-8caa-3db44ce5847d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046823 Aug 24 15:52:00.926347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 386/744] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:00.955205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:00.955848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:00.963290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:00.963825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:00.964260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:00.964971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:00.965422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:00.965845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:01.100985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:01.109204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc85fa94-228b-4145-83f6-a07e88b4b5a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158159 Aug 24 15:52:01.109771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 359/745] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:01.938970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:01.941094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:01.947588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:01.948104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:01.948535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:01.949220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:01.949666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:01.950077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:01.979191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-36c2ad8b-0bee-4167-b3e1-d2afb1aebdae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044142 Aug 24 15:52:01.979766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 387/746] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:02.130983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:02.131594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:02.138234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.138732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.139204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.140005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.140497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.140925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.276177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:02.276615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:02.278186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:02.282546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.283032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.283468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.284185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.284637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.285690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.287363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3355b955-a8e0-4f68-9096-1c72c064c6ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160584 Aug 24 15:52:02.287973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 360/747] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:02.308673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d0a55803-159b-4826-864c-de47c9e9a61d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/ips" status: 200 len: 150 microversion: 2.1 time: 0.036449 Aug 24 15:52:02.309234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 388/748] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:52:02 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:02.320978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a264c788-5cff-4354-b22c-9a58b4e7f283"}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:02.323515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:02.329438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.330176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.330616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.331303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.331801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.333174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.346463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:02.413667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Invalid volume: volume a264c788-5cff-4354-b22c-9a58b4e7f283 is already attached to instances: a234e501-bc78-49d3-840c-65ec61718cc0 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: POST /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/os-volume_attachments HTTP/1.1 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 74 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:52:02.415382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {"volumeAttachment": {"volumeId": "a264c788-5cff-4354-b22c-9a58b4e7f283"}} Aug 24 15:52:02.416969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Invalid volume: volume a264c788-5cff-4354-b22c-9a58b4e7f283 is already attached to instances: a234e501-bc78-49d3-840c-65ec61718cc0 Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'server_id': 'c8140eb7-59b4-41da-821d-1dff940c68af', 'body': {'volumeAttachment': {'volumeId': 'a264c788-5cff-4354-b22c-9a58b4e7f283'}}} Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a264c788-5cff-4354-b22c-9a58b4e7f283 is already attached to instances: a234e501-bc78-49d3-840c-65ec61718cc0 Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:02.417800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a264c788-5cff-4354-b22c-9a58b4e7f283 is already attached to instances: a234e501-bc78-49d3-840c-65ec61718cc0 Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:02.419336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a264c788-5cff-4354-b22c-9a58b4e7f283 is already attached to instances: a234e501-bc78-49d3-840c-65ec61718cc0 Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 400 to user: Invalid volume: volume a264c788-5cff-4354-b22c-9a58b4e7f283 is already attached to instances: a234e501-bc78-49d3-840c-65ec61718cc0 {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ff69f31c-8b6c-4896-a68b-5f6cd8856b45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100280 Aug 24 15:52:02.420801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 361/749] 10.222.0.102 () {60 vars in 1328 bytes} [Wed Aug 24 15:52:02 2022] POST /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:52:02.425416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:02.425905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:02.432108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.432592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.433050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.433765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.434213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.434630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.460154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:52:02.534409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e2a3c7b7-dd26-4737-84fc-2ef3b2cde9f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 204 len: 0 microversion: 2.1 time: 0.112424 Aug 24 15:52:02.535010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 389/750] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:52:02 2022] DELETE /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:52:02.543505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:02.544155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:02.550239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.550762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.551868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.552580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:02.553041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:02.553473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:02.690677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:02.699035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-320e3faa-afb8-4033-985b-55c57fee01e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.159406 Aug 24 15:52:02.699600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 362/751] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:02 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:02.993618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:02.996153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:03.002943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:03.003434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:03.004576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:03.006023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:03.006495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:03.006925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:03.039586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b0dcb8e9-f858-4428-9509-cbb7111449b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051758 Aug 24 15:52:03.040183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 390/752] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:03.309471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:03.310075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:03.316461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:03.316994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:03.317428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:03.318118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:03.318567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:03.318990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:03.450182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:03.458829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-252f892c-9a85-4e5e-949c-416dc867f241 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153125 Aug 24 15:52:03.459398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 363/753] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:03.720363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:03.721005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:03.727657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:03.728145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:03.728576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:03.729262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:03.729709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:03.730157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:03.912358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:03.920393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ece4101-8174-42f8-aa98-7855076364c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.203813 Aug 24 15:52:03.920994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 391/754] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:03 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:04.155893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:04.158158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:04.164192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:04.164615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:04.165055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:04.165745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:04.166196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:04.166618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:04.195885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0e9108f1-2809-426d-829c-15eaea73f544 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148231 Aug 24 15:52:04.196452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 364/755] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:04.480663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:04.480663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:04.487098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:04.487578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:04.488029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:04.489360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:04.489810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:04.490233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:04.629610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:04.637905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3785e2aa-1060-4084-ad13-3ac3665eb28b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.161838 Aug 24 15:52:04.638473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 392/756] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:04.945161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:04.945773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:04.952106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:04.952588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:04.953026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:04.953720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:04.954172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:04.954599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:05.084300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:05.092112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-003d5dfb-228d-43ee-9d00-fc516160b708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.150891 Aug 24 15:52:05.092676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 365/757] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:04 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:05.209574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:05.211851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:05.217828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:05.218314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:05.218752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:05.219444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:05.219930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:05.220358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:05.223448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:05.254171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c05c580-dd21-4a18-aeb2-3adf7db73ae9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048911 Aug 24 15:52:05.254406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 393/758] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:05.658887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:05.659492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:05.665863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:05.666346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:05.666779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:05.667464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:05.667944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:05.668376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:05.802758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:05.811130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4968d385-d993-4876-b0db-df81ec3b1c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156254 Aug 24 15:52:05.811709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 366/759] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:06.114866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:06.115394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:06.121910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:06.122395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:06.122827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:06.123515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:06.124011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:06.124435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:06.256129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:06.263876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa64d8f9-2a68-4217-ad45-397af56f2344 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.153686 Aug 24 15:52:06.264449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 394/760] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:06 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:06.266446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:06.268824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:06.275375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:06.275920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:06.276388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:06.277073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:06.277794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:06.277939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:06.308258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-69ea7f50-a35a-450d-9fae-f2563a7ca142 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045788 Aug 24 15:52:06.308811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 367/761] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:06.835967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:06.836789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:06.849403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:06.849909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:06.850354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:06.851071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:06.851655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:06.852645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:06.989347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:06.998033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-abcc7695-3a7e-4982-ac61-778f60484ae0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.166857 Aug 24 15:52:06.998610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 395/762] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:07.284653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:07.285311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:07.292276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:07.292749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:07.293186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:07.293873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:07.294326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:07.294750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:07.320659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:07.322859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:07.329291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:07.330017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:07.330456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:07.331153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:07.331604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:07.332093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:07.362507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2348a1b9-53ed-47f8-9134-47b6aca8b2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046435 Aug 24 15:52:07.363924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 396/763] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:07.440464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:07.448898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-14a88b2b-4f16-4765-8325-27d5be23ce89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.168114 Aug 24 15:52:07.449469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 368/764] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:07 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:08.020574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:08.021179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:08.027125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:08.027612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:08.028144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:08.028843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:08.029295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:08.029725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:08.167805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:08.177576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-31473560-77df-469f-9abb-247c7c5460b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.161214 Aug 24 15:52:08.178199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 397/765] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:08.374680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:08.376840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:08.384458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:08.385058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:08.385416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:08.386127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:08.386585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:08.387013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:08.418157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8deff143-e343-42c5-bfb5-f3a853284f1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047470 Aug 24 15:52:08.418715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 369/766] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:08.470189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:08.470802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:08.478106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:08.478602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:08.479040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:08.479785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:08.480246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:08.480676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:08.612026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:08.619730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7bdf449b-2e57-4183-bd7f-7f6eb8ae6caa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.153328 Aug 24 15:52:08.620294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 398/767] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:08 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:09.198939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:09.199578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:09.205910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:09.206386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:09.206820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:09.207605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:09.208076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:09.208493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:09.334886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:09.343364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6e657e26-105b-44b6-99c8-52bb3d1b67b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.148139 Aug 24 15:52:09.344091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 370/768] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:09.431048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:09.433202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:09.439286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:09.439815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:09.440260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:09.440951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:09.441452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:09.442008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:09.470693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d48b205-5d52-4fbf-aefc-b398a1c20704 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043473 Aug 24 15:52:09.471294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 399/769] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:09.642691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:09.643333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:09.650569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:09.651380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:09.652048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:09.652830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:09.653357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:09.653880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:09.787835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:09.795481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d8921939-dd24-4bc0-8cf8-17c119e4a22e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.156738 Aug 24 15:52:09.796077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 371/770] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:09 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:10.365001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:10.365589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:10.372181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:10.372674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:10.373111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:10.373809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:10.374271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:10.374700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:10.483575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:10.485724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:10.492417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:10.492908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:10.493392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:10.494125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:10.494576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:10.494998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:10.513240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:10.521996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-41231e2c-9560-48ee-b5e1-ef50799a14ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.161615 Aug 24 15:52:10.522577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 400/771] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:10.526002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c1c64be-9990-45ab-aaf1-6dbd3242b489 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046355 Aug 24 15:52:10.526560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 372/772] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:10.817339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:10.817948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:10.824471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:10.824958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:10.825398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:10.826102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:10.826559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:10.826992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:10.956678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:10.964828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f560a211-c838-4e52-9587-b354b756e7ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.151773 Aug 24 15:52:10.965395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 401/773] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:10 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:11.537966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:11.540172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:11.542044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:11.542532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:11.546617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.547096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.547530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.548264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.548610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.548736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.549095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.549210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.549530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.550224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.550682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.551173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.580554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-20368e59-5c5b-4d85-be85-aaf06f06c11b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046441 Aug 24 15:52:11.581119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 373/774] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:11.685206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:11.693885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-372dc1fd-5de6-42a4-b9aa-e9decc32a192 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155651 Aug 24 15:52:11.694448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 402/775] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:11.986649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:11.987264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:11.993735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.994220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.994656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.995350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.995842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.996266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:12.131431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:12.139080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-137f763c-f8ff-4602-b103-47c10148e193 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.156298 Aug 24 15:52:12.139668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 374/776] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:11 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:12.594041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:12.596214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:12.602918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:12.603404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:12.603900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:12.604598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:12.605051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:12.605472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:12.635119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54a8e1f6-a3a5-4f1c-86be-e49f15990d58 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045100 Aug 24 15:52:12.635797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 403/777] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:12.715706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:12.716429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:12.722823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:12.723475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:12.723770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:12.724464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:12.724919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:12.725343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:12.859554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:12.868220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9f0e44dc-165f-45bd-b2b4-64da322fff0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156386 Aug 24 15:52:12.869007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 375/778] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:13.164446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:13.165096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:13.171076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:13.171569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:13.172050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:13.172736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:13.173193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:13.173618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:13.303210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:13.310790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c640f38-6945-42ea-95af-7a8d64274a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.150759 Aug 24 15:52:13.311382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 404/779] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:13 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:13.648255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:13.650446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:13.656423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:13.656900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:13.657330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:13.658028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:13.658473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:13.658897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:13.687155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dcb93c88-3af4-456b-82a0-42c941cb6ebf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043583 Aug 24 15:52:13.687723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 376/780] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:13.889892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:13.890533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:13.898388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:13.898879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:13.899317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:13.900045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:13.900500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:13.900927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:14.028747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:14.037423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d612b99-c7d2-4063-b744-3e2224482723 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151348 Aug 24 15:52:14.037993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 405/781] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:14.332190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:14.333062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:14.339572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:14.340086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:14.340651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:14.341324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:14.341776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:14.342200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:14.477493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:14.485051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aeeec808-4f3b-46c1-a293-8ac084acb7c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.157044 Aug 24 15:52:14.485610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 377/782] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:14 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:14.699476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:14.701532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:14.707931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:14.708453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:14.708881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:14.709569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:14.710018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:14.710434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:14.740403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-99977d88-91ed-4c42-ab03-6e311670c231 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044979 Aug 24 15:52:14.740997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 406/783] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:15.058450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:15.059058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:15.065254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:15.065740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:15.066181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.067532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:15.068029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:15.068461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.071007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:15.199772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:15.208757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6bfc6d39-80a8-47a0-a76b-6c54a145ca38 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154241 Aug 24 15:52:15.209324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 378/784] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:15.507501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:15.508130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:15.514717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:15.515199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:15.515724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.516447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:15.516897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:15.517317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.677709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:15.685636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2537dca7-35a7-40dc-933c-169fd151888c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.182768 Aug 24 15:52:15.686242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 407/785] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:15 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:15.753206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:15.755530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:15.763093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:15.763579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:15.764040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.764729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:15.765172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:15.765589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.802111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c4d808f1-2658-46ab-8e33-16b03d1030d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053205 Aug 24 15:52:15.802682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 379/786] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:16.230024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:16.230628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:16.236542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.237023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.237462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.238137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.239244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.239687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.373037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:16.381752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-833414dc-2069-43cb-bc49-50e9f3fc03c7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155776 Aug 24 15:52:16.382315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 408/787] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:16.710372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:16.710976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:16.716946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.717429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.717863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.718552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.719003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.719424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.814115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:16.816289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:16.824045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.824541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.824976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.825684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.826142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.826568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.854533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:16.857221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:16.862579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-64f470b5-047c-4884-817c-55ba58484abd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052336 Aug 24 15:52:16.862821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c0846bfb-3d05-478f-851c-ec345692016e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.157214 Aug 24 15:52:16.863238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 409/788] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:16.863699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 380/789] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:16 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:17.403189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:17.404004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:17.409879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.410883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.411946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.412656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.413121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.413552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.543286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:17.552079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7f4f7401-92fc-46d0-8c4c-ac28d8293732 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.152327 Aug 24 15:52:17.552797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 410/790] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:17.874590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:17.876744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:17.883456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.883732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:17.884158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.884351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:17.884459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.885085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.885541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.885972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.890915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.891405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.891960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.892667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.893119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.893546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.916662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c5745c61-aeea-45ad-b1ed-797057aecfa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045891 Aug 24 15:52:17.917154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 381/791] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:18.037241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:18.045869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d905425-4f3e-4654-b4f8-a023c3a329a0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.166008 Aug 24 15:52:18.046445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 411/792] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:17 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:18.573858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:18.574473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:18.580638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:18.581159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:18.581597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:18.582295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:18.582750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:18.583180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:18.717626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:18.725812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3c516ec1-a4aa-4297-902b-a6a3ead10176 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155904 Aug 24 15:52:18.726378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 382/793] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:18.929871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:18.932164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:18.934517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:18.940347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:18.940916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:18.941353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:18.942497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:18.942955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:18.943389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.068713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:19.069538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:19.076513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:19.077013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:19.077457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.078172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:19.078634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:19.079065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.127535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa10ce21-904e-4e1a-a4ca-7fb96e8e75d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.202302 Aug 24 15:52:19.128056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 412/794] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:19.214661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:19.222349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ac13eb2a-a0e1-4dc0-8ace-11429f5eea6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.157887 Aug 24 15:52:19.223410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 383/795] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:19 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:19.746739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:19.747348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:19.753520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:19.754013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:19.755028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.755775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:19.756236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:19.756672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.902723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:19.911459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2b6c312c-ebcb-4174-b28f-510843db6319 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.168466 Aug 24 15:52:19.912061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 413/796] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:20.140657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:20.143908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:20.155998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.156486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.156921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.157618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.158067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.158488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.187939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-33d157aa-ac70-48c1-bc92-027e0dedf98a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052050 Aug 24 15:52:20.188496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 384/797] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:20.244768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:20.245382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:20.252675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.253197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.253871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.255438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.255933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.256490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.384985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:20.392878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a56847f0-16ca-48ba-91f7-4f31a0f854e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.151888 Aug 24 15:52:20.393384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 414/798] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:20 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:20.933212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:20.933831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:20.940003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.940494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.940929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.941710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.942367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.942785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:21.071252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:21.079482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b1522185-6748-4069-920e-2e61a425ef4c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.150280 Aug 24 15:52:21.080085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 385/799] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:21.201433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:21.203560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:21.210572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:21.211061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:21.211495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:21.212218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:21.212675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:21.213097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:21.242215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ecf1ffd0-38b7-4b3e-8b33-6c992063c1a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Aug 24 15:52:21.242767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 415/800] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:21.414372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:21.414958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:21.421367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:21.421845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:21.422272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:21.422952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:21.423401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:21.423853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:21.555177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:21.562848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2258a975-606a-42a2-958f-b1735c49cdef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.152306 Aug 24 15:52:21.563426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 386/801] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:21 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:22.102582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:22.103135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:22.109609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:22.110100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:22.110571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.111677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:22.112448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:22.112890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.248449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:22.254456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:22.256768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:22.257102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b4c7968a-2f69-42fc-84b0-5966d5fc4d29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158892 Aug 24 15:52:22.257669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 416/802] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:22.258923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=72 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:22.264565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:22.265151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:22.265656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.266433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:22.266960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:22.267455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.298952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-13b95afe-2869-464b-9b89-709dbd8499e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048404 Aug 24 15:52:22.299586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 387/803] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:22.585562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:22.586168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:22.592027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:22.592507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:22.592937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.593623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:22.594071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:22.594492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.728868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:22.736664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eb187d26-91c0-4b8e-9a84-5ee7b6858fe9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.155764 Aug 24 15:52:22.737199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 417/804] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:22 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:23.279493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:23.280179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:23.287252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.287773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.288247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.289035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.289517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.289948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.311506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:23.313586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:23.319995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.320477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.320917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.321611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.322058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.322477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.355548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6053ad76-44ac-41b1-be16-29b88448cd65 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048023 Aug 24 15:52:23.356156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 418/805] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:23.421992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:23.430174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1aebe2a6-cd80-437f-b3b8-2085eb228ad1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154502 Aug 24 15:52:23.430741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 388/806] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:23.757873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:23.758494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:23.764340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.765006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.765248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.765939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.766391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.766817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.899804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:23.908078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f038f8ff-dd47-467e-b31a-652a86990b55 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.154582 Aug 24 15:52:23.908640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 419/807] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:23 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:24.368566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:24.370715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:24.377236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.377714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.378149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.378975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.379717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.380148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.408511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4a75c600-6200-4ef4-9865-6004ead2ff10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044583 Aug 24 15:52:24.409065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 389/808] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:24.451681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:24.452312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:24.459112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.459602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.460062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.460758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.461218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.461645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.593871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:24.605445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d3bca975-8eb0-49ee-b02b-9b980c36d3c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155021 Aug 24 15:52:24.605445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 420/809] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:24.930099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:24.930747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:24.936816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.937305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.937740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.938446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.938901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.939329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.069965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:25.077671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f97d5f70-2c87-458f-8122-84198330f6bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.152105 Aug 24 15:52:25.078237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 390/810] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:24 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:25.421972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:25.424171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:25.430737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:25.431224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:25.431726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.432378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:25.432836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:25.433262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.463226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d318824f-81f0-42d0-86d0-cd8c3d377eb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045305 Aug 24 15:52:25.463968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 421/811] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:25.623988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:25.624584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:25.632570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:25.633160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:25.633704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.634499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:25.635047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:25.635569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.771396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:25.779568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-db25dda5-f409-40d9-a0a1-eeada0847c6c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159427 Aug 24 15:52:25.780173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 391/812] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:26.100564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:26.101090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:26.106914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.107394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.107881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.108569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.109015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.109432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.256948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:26.264780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-65bd69b9-ccfe-42f7-ad08-5258493cd49a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.168817 Aug 24 15:52:26.265336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 422/813] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:26 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:26.475806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:26.477989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:26.484129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.484618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.485055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.485756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.486207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.486632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.516734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78e72707-7689-4672-8515-4c3c46e73aff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045000 Aug 24 15:52:26.517287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 392/814] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:26.801387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:26.801924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:26.808853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.809373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.809813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.810511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.810972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.811398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.955138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:26.963990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3b1049b-66d8-412c-a9f8-050f34fc80d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.166533 Aug 24 15:52:26.964541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 423/815] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:27.286439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:27.287586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:27.294349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.294822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.295252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.295974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.296418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.296836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.424846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:27.433792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-595d64ff-8ee5-48f0-b857-891bbc0d5a1a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.151230 Aug 24 15:52:27.434367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 393/816] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:27 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:27.529873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:27.532080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:27.539095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.539519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.539982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.540679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.541134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.541560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.570019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f01e361-03d8-40eb-ba62-fdf7c2d4f6e2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044227 Aug 24 15:52:27.570580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 424/817] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:27.985340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:27.985956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:27.992713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.993354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.993775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.994532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.994998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.995423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:28.131268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:28.133456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:28.141207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6510d798-d965-4873-b655-5c191463221c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159352 Aug 24 15:52:28.141403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 394/818] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:28.455725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:28.456600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:28.462643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:28.463134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:28.463567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:28.464290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:28.464745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:28.465172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:28.581743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:28.583934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:28.590405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:28.590891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:28.591333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:28.592076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:28.592532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:28.592958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:28.595082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:28.604144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-39edb96c-f25e-4754-a7eb-4b7ea908c7c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.152151 Aug 24 15:52:28.604967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 425/819] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:28 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:28.624770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-77d1efa7-f2db-4b40-acfc-5988299be960 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047221 Aug 24 15:52:28.625328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 395/820] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:29.163760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:29.164371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:29.170350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.170835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.171269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.171986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.172442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.172864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.188333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:29.301213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:29.309358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-251d9847-819e-4b4e-93c2-72e1c7e01b44 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.150162 Aug 24 15:52:29.309931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 426/821] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:29.626438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:29.626983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:29.634506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.634998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.635447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.636186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.636647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.637075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.637690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:29.639853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:29.646875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.647476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.648015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.648715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.649165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.649717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.680503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b3575690-18de-458f-88f6-c7053970cbd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046814 Aug 24 15:52:29.681093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 427/822] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:29.773718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:29.781382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-02d747c3-c62e-4aba-ad9f-b83f726c5305 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.158892 Aug 24 15:52:29.781953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 396/823] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:29 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:30.330344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:30.330864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:30.337103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.337580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.338010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.338692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.339141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.339560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.471937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:30.481883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2d4d8f92-99bd-457b-92c0-2108ffea876e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155422 Aug 24 15:52:30.482448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 428/824] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:30.693034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:30.695338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:30.701805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.702286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.702720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.703412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.703895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.704324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.735456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-19ab9fc5-331d-4ad2-beeb-ef663c282ac0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046313 Aug 24 15:52:30.736055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 397/825] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:30.802496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:30.803114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:30.809509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.809999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.810440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.811137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.811597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.812127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.949786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:30.957837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-430ba8cd-16e0-4e46-8f54-7e5b7e3e880e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.159181 Aug 24 15:52:30.958404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 429/826] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:30 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:31.053782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:31.055948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:31.061922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.062391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.062850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.063534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.064028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.064457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.094375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b3687314-b044-42be-805b-e5a1b620a5dc tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044569 Aug 24 15:52:31.094934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 398/827] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:31 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:52:31.156669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:31.157171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:31.163876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.164374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.164815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.165520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.165984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.166415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.190524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:52:31.267110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-19120cb6-8b8c-434f-b7bc-328c9b699830 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 204 len: 0 microversion: 2.1 time: 0.113921 Aug 24 15:52:31.267720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 430/828] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:52:31 2022] DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:52:31.275911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:31.276528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:31.282508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.282994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.283454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.284161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.284620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.285048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.413071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:31.420708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5c13156f-25b7-42ba-99c6-beaeb9b8febe tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.148768 Aug 24 15:52:31.421268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 399/829] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:31 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:31.504163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:31.504790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:31.511437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.511970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.512450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.513148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.513605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.514033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.645002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:31.653232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-daa7d1b0-08de-42c4-a7d6-87f9fd00dd94 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153359 Aug 24 15:52:31.653809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 431/830] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:31.747876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:31.750104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:31.756844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.757266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.757700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.758407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.758903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.759708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.802038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cafb3782-471e-485b-8070-eb1769fe9c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058102 Aug 24 15:52:31.803340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 400/831] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:31.980056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:31.980770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:31.987052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.987560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.988034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:31.988725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:31.989175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:31.989595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.127480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:32.136534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9643ff39-bf53-4121-aefd-cc76d7f86b40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.160026 Aug 24 15:52:32.137210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 432/832] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:31 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:32.442138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:32.442751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:32.449263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:32.449744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:32.450175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.450865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:32.451319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:32.451777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.587029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:32.594692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9c287e89-2a90-4f67-a7d2-57316c1f2ee9 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.156374 Aug 24 15:52:32.595269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 401/833] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:32 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:32.675009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:32.675671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:32.682022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:32.682509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:32.682943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.683640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:32.684120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:32.684542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.814622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:32.815649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:32.817828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:32.824368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1be10bed-95fa-409d-a705-fc335bfbfa8d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153183 Aug 24 15:52:32.825132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 433/834] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:32.825255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:32.825713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:32.826145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.826846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:32.827296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:32.827742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:32.859093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05b9e386-620b-4936-814e-204e32a44ab2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047354 Aug 24 15:52:32.859740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 402/835] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:33.159103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:33.159820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:33.166692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.167179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.167659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.168366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.168819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.169245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.300089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:33.308895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e28066d5-0cc0-4658-8472-3278f818656f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.154175 Aug 24 15:52:33.309471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 434/836] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:33 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:33.616200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:33.616811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:33.622774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.623262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.623727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.624423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.624880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.625303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.751003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:33.759011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-32de1b8d-f3bf-4d4c-9cfc-9f1fb0a45bbf tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.146808 Aug 24 15:52:33.759581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 403/837] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:33 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:33.846356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:33.846971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:33.853767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.854256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.854695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.855397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.855892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.856321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.872657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:33.874729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:33.881777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.882246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.882675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.883363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:33.883836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:33.884254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:33.915149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-53c35ace-c1b2-4a45-af2a-1507506c3f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047232 Aug 24 15:52:33.915740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 404/838] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:33.989103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:33.997487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-83ba2582-b8ef-4b45-92a5-2e2e40916318 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154973 Aug 24 15:52:33.998046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 435/839] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:34.330946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:34.331870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:34.338801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:34.339325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:34.339792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:34.340554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:34.341012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:34.341438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:34.478263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:34.488078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b6070e0c-cfe9-4b02-b187-0dcac65639b9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.160897 Aug 24 15:52:34.488661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 405/840] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:34 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:34.780563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:34.781177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:34.788993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:34.789484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:34.789926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:34.790627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:34.791093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:34.791525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:34.928545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:34.930756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:34.932378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:34.937408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:34.937895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:34.938330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:34.939064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:34.939515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:34.939967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:34.940219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0460017f-ae7d-4d83-9892-af17ef36e5cb tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.163585 Aug 24 15:52:34.940796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 436/841] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:34 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:34.970227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f97032f-6066-42f3-8376-925777891c83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046425 Aug 24 15:52:34.970787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 406/842] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:35.018752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:35.019367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:35.025951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.026441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.026885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.027581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.028068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.028495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.171794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:35.177348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8b7e16c1-e99c-42fe-99a9-f72c013b6497 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.162360 Aug 24 15:52:35.178717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 437/843] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:35.511285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:35.511920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:35.517895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.518370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.518798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.519515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.519985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.520430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.654800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:35.662741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-50bce32f-808d-4602-9697-bf3f77992402 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.156160 Aug 24 15:52:35.663302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 407/844] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:35 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:35.962335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:35.962861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:35.969335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.969818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.970254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.970943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.971399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.971852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.983553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:35.985861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:35.992157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.993152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.993597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:35.994293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:35.994745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:35.995163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:36.025733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4977bd92-b9e8-4c2f-8cb1-730a975a5b0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046168 Aug 24 15:52:36.026295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 408/845] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:36.103949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:36.111711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f57d734b-ecbf-4b91-b468-605f18518425 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.153317 Aug 24 15:52:36.112368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 438/846] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:35 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:36.199485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:36.200351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:36.206698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:36.207215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:36.207680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:36.208492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:36.208946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:36.209370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:36.340696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:36.348920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9ce81e7-2544-4e89-b558-1fd081678d17 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153415 Aug 24 15:52:36.349484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 409/847] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:36.684136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:36.684748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:36.690761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:36.691250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:36.691710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:36.692405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:36.692859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:36.693285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:36.836408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:36.845714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d0a1921-aa86-4a97-bd35-bb752c598294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.165397 Aug 24 15:52:36.846547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 439/848] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:36 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:37.038368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:37.040645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:37.047006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.047494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.048101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.048793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.049246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.049669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.079348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4d7f0a2a-3313-4e3d-855d-b7c42d176fe5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044950 Aug 24 15:52:37.079932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 410/849] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:37.134597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:37.135225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:37.141678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.142174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.142613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.143316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.143814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.144243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.274866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:37.282704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4694a407-150b-438b-b0e7-cbd621d54bf0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.152885 Aug 24 15:52:37.283281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 440/850] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:37 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:37.371309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:37.371943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:37.378109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.378585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.379028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.379769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.380227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.380654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.396792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:37.512634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:37.520547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3933c3ba-ad43-4364-904a-f49e23d666cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153763 Aug 24 15:52:37.521122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 411/851] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:37.866357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:37.866973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:37.873564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.874052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.874488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.875180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:37.875653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:37.876082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:37.890958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:38.007600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:38.015395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f1e5bebc-0df3-45a8-b49a-d0ed40674dd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.152897 Aug 24 15:52:38.015981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 441/852] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:37 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:38.092878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:38.095035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:38.101471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:38.101888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:38.103154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:38.104188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:38.104663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:38.105092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:38.135203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d1f49469-4f30-4deb-827c-faf644a3d09b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046299 Aug 24 15:52:38.135783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 412/853] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:38.303240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:38.303878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:38.312528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:38.313023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:38.313462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:38.314195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:38.314653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:38.315102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:38.444748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:38.452874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc2ae7fc-ae5e-4f6b-9f24-18c6abd66ff6 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.153541 Aug 24 15:52:38.453886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 442/854] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:38 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:38.546320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:38.546937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:38.552914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:38.553399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:38.553836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:38.554534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:38.554996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:38.556299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:38.687656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:38.696089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2f5779cb-1736-4e9b-825c-d297c1b08368 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158642 Aug 24 15:52:38.697172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 413/855] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:39.037652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:39.038262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:39.044911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.045396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.045834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.046522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.046977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.047400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.150647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:39.154877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:39.162803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.163606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.164082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.166231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.166702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.167307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.181347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:39.190971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7f0f996a-7521-4448-88e3-bf2b2f80b47f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.157147 Aug 24 15:52:39.191829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 443/856] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:39 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:39.207379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7afd0cc0-ba11-4bf1-b3b0-6835267aa815 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062254 Aug 24 15:52:39.208017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 414/857] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:39.475245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:39.475886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:39.482301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.482782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.483215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.483928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.484383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.484806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.718720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:39.719494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:39.726044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.726624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.727176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.727992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:39.728521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:39.729018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:39.878762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:39.889986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4a6cdb32-4355-4ba2-a7aa-f4e2f9cd483d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.418497 Aug 24 15:52:39.890555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 444/858] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:39 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:39.934222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:39.952305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a2ae0f2-9e2e-443c-920c-0f8e5db199aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.237840 Aug 24 15:52:39.952890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 415/859] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:40.214394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:40.215009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:40.220957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:40.221616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.221616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.221890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.222591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.223044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.223159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:40.223473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.229936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.230410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.230838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.231527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.231992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.232415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.262498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a54df80-ab90-4471-a803-9947f0d9cfae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045433 Aug 24 15:52:40.263137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 416/860] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:40.362469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:40.370819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-91ef6348-ab04-4f5d-a240-60060b300786 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1686 microversion: 2.1 time: 0.161081 Aug 24 15:52:40.371374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 445/861] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:40 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:40.863391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:40.864127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:40.870261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.870839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.871351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.872151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.872696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.873190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.912687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:40.913218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:40.923143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.923654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.924105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:40.924820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:40.925277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:40.925701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.058756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:41.067707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-206e0606-6949-4464-a2a9-e20dabce9ec8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1599 microversion: 2.1 time: 0.208165 Aug 24 15:52:41.068400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 417/862] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:41.073701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:41.074508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:41.081606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:41.082391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:41.082833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.083540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:41.085981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:41.086657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.147200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:41.156869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-969445e6-92bf-440b-9047-04acd2f3da55 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1679 microversion: 2.1 time: 0.248024 Aug 24 15:52:41.157789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 446/863] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:40 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:41.277513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:41.280027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:41.286721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:41.287230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:41.287818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.288547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:41.289011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:41.289441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.308807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:41.324232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bbc3b3ed-7e0c-49ad-9e89-d3bb0011adc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.250092 Aug 24 15:52:41.325102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 418/864] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:41.328234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ce78cea1-493d-406b-b194-3b7694302520 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056585 Aug 24 15:52:41.332996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 447/865] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:41.392533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:41.393266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:41.400279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:41.401040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:41.401490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.402209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:41.402664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:41.403268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:41.483596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:41.496428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-72619c39-1b80-487d-9510-3c2cc500968f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1618 microversion: 2.1 time: 0.107274 Aug 24 15:52:41.510979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 419/866] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:41 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1618 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:42.179410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:42.180155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:42.198019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.199436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.204135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.204978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.205466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.205917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.328691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-ce1cab13-30e8-44fd-84b7-f1d7bc931d68 req-d25af65b-f490-461b-9176-13cc41e6d020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f1a7c0-a412-40d4-9809-6cbc75cae9a2", "name": "network-vif-deleted", "tag": "509dd32c-8be1-4c88-a113-55950e314a5a"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:42.345602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ce1cab13-30e8-44fd-84b7-f1d7bc931d68 req-d25af65b-f490-461b-9176-13cc41e6d020 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.346096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ce1cab13-30e8-44fd-84b7-f1d7bc931d68 req-d25af65b-f490-461b-9176-13cc41e6d020 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.346533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ce1cab13-30e8-44fd-84b7-f1d7bc931d68 req-d25af65b-f490-461b-9176-13cc41e6d020 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.375474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-ce1cab13-30e8-44fd-84b7-f1d7bc931d68 req-d25af65b-f490-461b-9176-13cc41e6d020 service nova] Creating event network-vif-deleted:509dd32c-8be1-4c88-a113-55950e314a5a for instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 on hv-cinder-84932 Aug 24 15:52:42.385205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:42.397854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-997f0057-2d3c-4f90-a990-0e6946cb4734 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1611 microversion: 2.1 time: 0.220649 Aug 24 15:52:42.398274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-ce1cab13-30e8-44fd-84b7-f1d7bc931d68 req-d25af65b-f490-461b-9176-13cc41e6d020 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202073 Aug 24 15:52:42.400574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 420/868] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:42.400770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 448/868] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:42 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1611 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:42.407063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:42.412061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:42.422534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.425671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.426314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.428460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:42.428864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.429498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.432256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.441603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:42.473861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.478109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.478312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.479063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.485338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.485833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.574553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22096723-c442-4bb3-b910-39386cafcd35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172528 Aug 24 15:52:42.576369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 449/869] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:42.587567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:42.588243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:42.605337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.607529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.609240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.612235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:42.612811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:42.613271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:42.906665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:42.926031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3ec8af67-78e8-4a91-b239-15aecf1ffc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1330 microversion: 2.1 time: 0.344546 Aug 24 15:52:42.927591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 450/870] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:42 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1330 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:42.988629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:43.004624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-74a17e7a-bd73-492a-83dc-95c9cc5a1a28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.602285 Aug 24 15:52:43.005505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 421/871] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:43.424348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:43.424862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:43.433324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.433847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.434243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:43.439929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.440643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.443600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:43.504048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.504777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.505391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:43.506004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lazy-loading 'fault' on Instance uuid 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:52:43.590953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:43.596227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:43.614257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.615145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.616242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:43.617007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.617614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.618057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:43.644592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:43.653147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f000f28d-2a3a-4bcf-ada4-3af41ea1d74e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 200 len: 1332 microversion: 2.1 time: 0.232576 Aug 24 15:52:43.658869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-13d81ae6-ebdb-4d0a-a089-f77fe0f96173 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074721 Aug 24 15:52:43.659071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 451/872] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:43 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:43.659171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 422/873] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:43.953483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:43.954426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:43.964229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.965518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.966192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:43.969336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:43.971612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:43.975780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.022433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.023428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.024667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.026128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lazy-loading 'fault' on Instance uuid c8140eb7-59b4-41da-821d-1dff940c68af {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:52:44.032720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:44.033435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:44.052586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.053443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.054097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.055040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.056428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.057114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.192209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:44.202101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ae5358d2-38e0-4442-8703-f61cb2f1bf4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 200 len: 1335 microversion: 2.1 time: 0.256562 Aug 24 15:52:44.220037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 452/874] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:43 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 1335 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:44.381879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:44.382713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-285dca9b-64f1-481e-8196-2f1340c5468c req-f8a1a26a-6415-4c05-b1f4-c28c996151b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:44.392321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fe151c1e-d736-4b89-8b6d-66110632a31c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.364798 Aug 24 15:52:44.396872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 423/875] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:44.402232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-285dca9b-64f1-481e-8196-2f1340c5468c req-f8a1a26a-6415-4c05-b1f4-c28c996151b2 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.403082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-285dca9b-64f1-481e-8196-2f1340c5468c req-f8a1a26a-6415-4c05-b1f4-c28c996151b2 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.403616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-285dca9b-64f1-481e-8196-2f1340c5468c req-f8a1a26a-6415-4c05-b1f4-c28c996151b2 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.416953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-285dca9b-64f1-481e-8196-2f1340c5468c req-f8a1a26a-6415-4c05-b1f4-c28c996151b2 service nova] Creating event network-changed:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 15:52:44.422371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-285dca9b-64f1-481e-8196-2f1340c5468c req-f8a1a26a-6415-4c05-b1f4-c28c996151b2 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194753 Aug 24 15:52:44.423068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 453/876] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:44.438254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-13b8fc38-d685-4b8b-875b-b2f448ac89fc req-a1b3cf7e-1ed7-484c-8c07-135b29d2d6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8140eb7-59b4-41da-821d-1dff940c68af", "name": "network-vif-deleted", "tag": "c4bd3070-d90f-46b2-a723-c73a2b4920d0"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:44.448210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-13b8fc38-d685-4b8b-875b-b2f448ac89fc req-a1b3cf7e-1ed7-484c-8c07-135b29d2d6b0 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.448684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-13b8fc38-d685-4b8b-875b-b2f448ac89fc req-a1b3cf7e-1ed7-484c-8c07-135b29d2d6b0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.449115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-13b8fc38-d685-4b8b-875b-b2f448ac89fc req-a1b3cf7e-1ed7-484c-8c07-135b29d2d6b0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.461111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-13b8fc38-d685-4b8b-875b-b2f448ac89fc req-a1b3cf7e-1ed7-484c-8c07-135b29d2d6b0 service nova] Creating event network-vif-deleted:c4bd3070-d90f-46b2-a723-c73a2b4920d0 for instance c8140eb7-59b4-41da-821d-1dff940c68af on hv-cinder-84932 Aug 24 15:52:44.466494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-13b8fc38-d685-4b8b-875b-b2f448ac89fc req-a1b3cf7e-1ed7-484c-8c07-135b29d2d6b0 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Aug 24 15:52:44.467085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 424/877] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:44.680866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:44.688194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:44.691142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:44.693629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:44.701336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.701822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.702256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.703022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.703475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.707909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.708439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.709088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.711151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.712893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:44.716243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:44.716890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:44.752345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] HTTP exception thrown: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Request method failure captured: Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 HTTP/1.1 Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf2xh-C1tFdiRt6FNZ5-FZgYhUh1suuo-ZiAQtKZc9vdNUJNh-ykM8-K9i9E8UsDkqPFnCLky4sQfFcRW5j83MuyvXMSfyH8Tq5arIZcIjWG6m3_iN5vpOz046PZgiKoAyLivIA4mPmk0t3vSMIi755nXyEP4OlpP5jAa7IjSAE8nc Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:52:44.756850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeTestJSON-206647015 Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeTestJSON-206647015-project Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 38f7d31cf0f541f58af7d3d850af6472 Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeTestJSON-206647015-project Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 15:52:44.758701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '17f1a7c0-a412-40d4-9809-6cbc75cae9a2'} Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:52:44.759757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 15:52:44.761301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:44.762667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Returning 404 to user: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:52:44.762667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-415c72d7-fc23-464a-aeec-ba3d73cdf9db tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 404 len: 111 microversion: 2.1 time: 0.086519 Aug 24 15:52:44.763950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 425/878] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:44 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:52:44.776796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-02d1702a-6c88-4ae7-94fd-63c809d1ea3d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '.version_select at 0x7fc5cc833430>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:44.811899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b7a3b71-ec2c-405f-8560-8cb44c0dcc7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140883 Aug 24 15:52:44.813006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 454/879] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:44.831489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-02d1702a-6c88-4ae7-94fd-63c809d1ea3d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695529222" status: 202 len: 0 microversion: 2.1 time: 0.064613 Aug 24 15:52:44.851398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 426/880] 10.222.0.102 () {58 vars in 1226 bytes} [Wed Aug 24 15:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695529222 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:52:45.228509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:45.229251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:45.235346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:45.235954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:45.236488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:45.237308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:45.237858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:45.238378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:45.254913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af HTTP/1.1 Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:52:45.256699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 15:52:45.258251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'c8140eb7-59b4-41da-821d-1dff940c68af'} Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:52:45.259522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 15:52:45.261005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:52:45.262113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:52:45.262113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5e066746-895f-41a4-acb0-ac48ab899468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 404 len: 111 microversion: 2.1 time: 0.036732 Aug 24 15:52:45.262113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 455/881] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:45 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:52:45.271473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a5e2634c-9975-43ea-94d8-1569bf697271 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '.version_select at 0x7fc5cc88d040>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:45.295865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a5e2634c-9975-43ea-94d8-1569bf697271 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330002248" status: 202 len: 0 microversion: 2.1 time: 0.029390 Aug 24 15:52:45.296820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 427/882] 10.222.0.102 () {58 vars in 1226 bytes} [Wed Aug 24 15:52:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330002248 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:52:45.415701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:45.416678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:45.423514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:45.424295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:45.424915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:45.425849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:45.426486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:45.427083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:45.829686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:45.833223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:45.839986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:45.840479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:45.840914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:45.841814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:45.849661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:45.850127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:45.884259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a12118f6-612a-4e42-969c-b47c59493fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063487 Aug 24 15:52:45.885157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 428/883] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:45.886252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:45.896291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e3e6c7d3-8336-4fe3-b5d1-36afcb6c4e86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.485600 Aug 24 15:52:45.908117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 456/884] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:46.219278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:46.219847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:46.225939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.226695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.227162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.227910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.228370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.228974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.292295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-92dabf79-dbef-4c6e-b70b-efd97068723e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'create', calling method: .version_select at 0x7fc5cc948280>, body: {"keypair": {"name": "tempest-keypair-347779940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjRB510z0CLFoVXY3OQVRDNV+wOKvJ1rRXFs37nMbBAbLzjoKJdm91Ibfl5AyJDRFrgGRcNg91rR7PaRrtvxkclR9R00tz0wn2bk3+fMDg+ADsck0Js1a2F216pS/YTDg=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:46.297759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:46.324562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-92dabf79-dbef-4c6e-b70b-efd97068723e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:52:46.330259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-92dabf79-dbef-4c6e-b70b-efd97068723e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for user 38f7d31cf0f541f58af7d3d850af6472 and project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:52:46.337882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lazy-loading 'services' on Instance uuid a234e501-bc78-49d3-840c-65ec61718cc0 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:52:46.355252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-92dabf79-dbef-4c6e-b70b-efd97068723e tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067113 Aug 24 15:52:46.355954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 457/885] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 15:52:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:46.360900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1833769808"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:46.361972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:46.368774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.369356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.369796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.370715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.371198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.371698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.433852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ed4f4c7-7693-4a4d-a967-198edfb324ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments/a264c788-5cff-4354-b22c-9a58b4e7f283" status: 202 len: 0 microversion: 2.1 time: 0.219009 Aug 24 15:52:46.434636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 429/886] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:52:46 2022] DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments/a264c788-5cff-4354-b22c-9a58b4e7f283 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:52:46.443248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:46.445700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:46.454625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.455203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.455906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.456717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.457499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.457996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.492234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a465fae5-bc49-46f4-8ff1-e9b920a11689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052991 Aug 24 15:52:46.494176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 430/887] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:46.533239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.network.security_group_api [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Adding security group c309deec-462e-4b91-aaad-7c8d23bcfd51 to port 2d2bfb11-9546-4df1-9050-8f910b8ceba3 Aug 24 15:52:46.896852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:46.899934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:46.908136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.923942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.924626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.925839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.926336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.926898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.958205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:46.972351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-656a9f8d-c66d-429f-b120-95366cfb3eba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079592 Aug 24 15:52:46.975831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 431/888] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:46.982683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:46.983445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:46.989970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.990469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.990672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e014d6d3-b165-4b2f-8e2e-e0801e818bcb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action" status: 202 len: 0 microversion: 2.1 time: 0.633487 Aug 24 15:52:46.991134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:46.991459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 458/889] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:52:46 2022] POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:52:46.991741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:46.992562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:46.992680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.000672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:47.001362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:47.013416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.015664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.016246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.017082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.019301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.019876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.381248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:47.391281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb9b2d4b-3bb1-4c8d-8eb6-4bea632f0db6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1718 microversion: 2.1 time: 0.414138 Aug 24 15:52:47.392761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 432/890] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1718 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:47.397583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-f15279ae-b7d3-42a7-bf4a-aea636dc6a90 req-d3f76511-3243-42be-8666-69d4884127be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:47.408101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-f15279ae-b7d3-42a7-bf4a-aea636dc6a90 req-d3f76511-3243-42be-8666-69d4884127be service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.408899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-f15279ae-b7d3-42a7-bf4a-aea636dc6a90 req-d3f76511-3243-42be-8666-69d4884127be service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.409563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-f15279ae-b7d3-42a7-bf4a-aea636dc6a90 req-d3f76511-3243-42be-8666-69d4884127be service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.425096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-f15279ae-b7d3-42a7-bf4a-aea636dc6a90 req-d3f76511-3243-42be-8666-69d4884127be service nova] Creating event network-changed:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 15:52:47.428307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:47.432560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-f15279ae-b7d3-42a7-bf4a-aea636dc6a90 req-d3f76511-3243-42be-8666-69d4884127be service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036051 Aug 24 15:52:47.433890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 433/891] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:47.445230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-779caabc-14b8-4d78-9374-0cf00323bbb5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1646 microversion: 2.1 time: 0.448277 Aug 24 15:52:47.448438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 459/892] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1646 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:47.474870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:47.476408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:47.486177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.486826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.487367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.488216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.489034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.489538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.507902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:47.511361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:47.524835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.525361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.525795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.526504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.526955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.527373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.537171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:47.576370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c425d451-4070-4b8c-a8a6-deac8c73b05d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073813 Aug 24 15:52:47.577254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 460/893] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:47.635165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] HTTP exception thrown: Cannot 'detach_volume' instance c5e42f6c-3744-4979-9c73-20f918be2be6 while it is in vm_state rescued Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Request method failure captured: Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments/d8aec088-688d-4945-8094-a0d52efe81b3 HTTP/1.1 Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkfwULJlZGKgX95heJf4zmfQ6lCot_jPsLm-uuJLOBYiTPd61Rpfd0r80qfrelDBVdp4_oRyr_KhacfwrVs7iJON0EExXBaJ12WgjncP4WQXgRdN9Qp4mwuq9HArNdls9ZOGzY3kTZ97wq-9MdyseP-yVzdtWRe3QQYdoDmWwCmTPsw Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:52:47.638447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 2fe5724620da46ddbefbdfd442dc8d73 Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:52:47.640149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Cannot 'detach_volume' instance c5e42f6c-3744-4979-9c73-20f918be2be6 while it is in vm_state rescued Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'server_id': 'c5e42f6c-3744-4979-9c73-20f918be2be6', 'id': 'd8aec088-688d-4945-8094-a0d52efe81b3'} Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c5e42f6c-3744-4979-9c73-20f918be2be6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:52:47.640862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c5e42f6c-3744-4979-9c73-20f918be2be6 while it is in vm_state rescued Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c5e42f6c-3744-4979-9c73-20f918be2be6 while it is in vm_state rescued Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:52:47.642741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Returning 409 to user: Cannot 'detach_volume' instance c5e42f6c-3744-4979-9c73-20f918be2be6 while it is in vm_state rescued {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:52:47.646534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-57d53199-df17-4d23-926a-08141946452e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments/d8aec088-688d-4945-8094-a0d52efe81b3" status: 409 len: 152 microversion: 2.1 time: 0.171442 Aug 24 15:52:47.646534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 434/894] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:52:47 2022] DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments/d8aec088-688d-4945-8094-a0d52efe81b3 => generated 152 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:52:47.651141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:47.651951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:47.660052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.660722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.661161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.661866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.662320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.662739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.756519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63a3e6b2-bf32-4b77-828b-d37e7da527fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/action" status: 202 len: 0 microversion: 2.1 time: 0.109837 Aug 24 15:52:47.761851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 461/895] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:52:47 2022] POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:52:47.775066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:47.776008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:47.778322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:47.789624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.792288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.793025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.793985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.794654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:47.795310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:47.985014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:47.988327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:47.998143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:47.999346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.000002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.000733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.001197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.001677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.013388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:48.026133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-52ca4b46-a5a2-41d4-b9a3-55bf2d2aeff9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1726 microversion: 2.1 time: 0.264175 Aug 24 15:52:48.027560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 435/896] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:48.054895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb79578d-e26e-4374-9f0e-3c04bf7aedef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074388 Aug 24 15:52:48.056422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 462/897] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:48.288887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-295140345", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de13cd90-f905-4ac9-8ee2-d6bd6b9d1ec9"}], "security_groups": [{"name": "tempest-securitygroup--1251136500"}], "key_name": "tempest-keypair-347779940", "user_data": "}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:48.396594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] validate_networks() for [('de13cd90-f905-4ac9-8ee2-d6bd6b9d1ec9', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:52:48.589304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:48.595841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:48.602576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.603824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.604272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.605080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.605547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.605972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.640518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e5570eea-2127-45a8-9c90-5b7b47d17a88 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055135 Aug 24 15:52:48.641031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 463/898] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:48.759065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:48.761717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:48.768102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.768585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.769041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.769774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.770225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.770639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.850734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:52:48.851275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:52:48.852011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:52:48.852775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9d6f0d81-fd95-4eba-be58-2659c7248038 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action" status: 202 len: 0 microversion: 2.1 time: 0.097510 Aug 24 15:52:48.853389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:52:48.853525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 464/899] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:52:48 2022] POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:52:48.856833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:52:48.861694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:48.862922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:48.865911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.866401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.866844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.867587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.868142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.868834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.869176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.869303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.869740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.870446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:48.870894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:48.871317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:48.888373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:52:48.892584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Getting quotas for user 38f7d31cf0f541f58af7d3d850af6472 and project b3568d52e7dd45b58640c06eddc5ea44. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:52:48.905167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:52:48.907834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:52:48.964327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5fdff3d0-e79d-4663-b19e-f6ad670b2515 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.679667 Aug 24 15:52:48.964981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 436/900] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 15:52:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 15:52:48.978611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-45007734-fd54-42b5-944f-1de8fc097cea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:48.979338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-45007734-fd54-42b5-944f-1de8fc097cea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:49.063200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-45007734-fd54-42b5-944f-1de8fc097cea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:49.074065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-45007734-fd54-42b5-944f-1de8fc097cea tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1240 microversion: 2.1 time: 0.099815 Aug 24 15:52:49.074833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 437/901] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:48 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:49.080086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:49.080949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:49.082663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:49.089929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:49.090555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:49.091179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:49.091929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:49.092386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:49.092813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:49.093303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-81e73916-9857-4ba1-82cf-853abb5b1b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1757 microversion: 2.1 time: 0.235603 Aug 24 15:52:49.093887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 465/902] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:49.109042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:49.111243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:49.120191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:49.120995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:49.121475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:49.122188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:49.122649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:49.123080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:49.156430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6396b333-bb9f-4a23-82d2-d6309bb8615e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053877 Aug 24 15:52:49.157011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 466/903] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:49.240748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:49.249964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a29e4c3a-230a-4a25-bc23-149c1fcca284 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1726 microversion: 2.1 time: 0.173838 Aug 24 15:52:49.250684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 438/904] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:49.652963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:49.655136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:49.661288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:49.661812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:49.662253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:49.662955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:49.663416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:49.663873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:49.696847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6e2da7d9-e95b-42d3-9add-b0bf5fe21056 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Aug 24 15:52:49.697325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 467/905] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:50.096050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:50.096596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:50.103327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.103966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.104406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.105106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.105552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.105963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.116928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:50.117541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:50.124692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.125179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.125611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.126313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.126767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.127310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.176010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:50.183901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e7a7c3b-bb52-4987-835c-1d5010b63e3b tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1244 microversion: 2.1 time: 0.091650 Aug 24 15:52:50.184478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 439/906] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:50 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:50.189107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:50.191342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:50.198240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.198740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.199191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.200105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.200567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.200999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.232666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-191ba091-33cc-49d7-b59e-03494eba3b3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047139 Aug 24 15:52:50.233433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 440/907] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:50.272283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:50.272980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:50.279744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.280220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.280657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.281355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.281811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.282233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.282340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:50.292016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-512f608d-1ec4-42a7-8525-d7221b7545a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1757 microversion: 2.1 time: 0.180186 Aug 24 15:52:50.292602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 468/908] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:50.432612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:50.442688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9f5c292-e5f1-4946-b01f-58d92d5cefd5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1726 microversion: 2.1 time: 0.174287 Aug 24 15:52:50.443259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 441/909] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:50.709459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:50.711679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:50.718939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.719443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.719988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.720827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:50.721159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:50.721918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:50.762258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fd57aad9-8615-447e-9c20-aeaab641304f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057037 Aug 24 15:52:50.762834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 469/910] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:51.204322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:51.204940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:51.211990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.212646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.213746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.214467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.214932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.215367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.245803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:51.248878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:51.256012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.256809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.257397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.258273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.258755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.259154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.283844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:51.289171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4962eef4-fb1e-4774-8c81-d540d7f0dd47 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048285 Aug 24 15:52:51.289740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 470/911] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:51.292100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a06581a0-a0a6-41c3-8b08-ed5aee8b2aad tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1292 microversion: 2.1 time: 0.091532 Aug 24 15:52:51.292663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 442/912] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:51 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:51.314014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:51.314612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:51.320512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.320992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.321424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.322262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.322721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.323144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.465085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:51.465701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:51.466536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:51.471847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.472337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.472776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.473478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.473932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.474361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.474919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6346e3eb-cd60-45cf-8f6c-6f421dbe98cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1757 microversion: 2.1 time: 0.164592 Aug 24 15:52:51.475483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 471/913] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:51.605751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:51.613833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c272103-16cf-40ff-87fb-487f70334d3e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1726 microversion: 2.1 time: 0.153327 Aug 24 15:52:51.614403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 443/914] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:51.774313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:51.777691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:51.783723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.784220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.784663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.785370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:51.785829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:51.786261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:51.816918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-83733e74-8aa7-45ce-a337-f930c41bea5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Aug 24 15:52:51.817401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 472/915] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:52.302275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:52.304438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:52.311239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.311751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.311903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:52.312307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.312499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:52.312883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.313333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.313757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.318571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.319055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.319490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.320215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.320707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.321291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.344010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-31a38d7f-f39c-4861-b175-f2bb4b1ce30d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045574 Aug 24 15:52:52.344702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 444/916] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:52.385693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:52.397887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b64292b6-330e-4412-971b-1a5a40b585be tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1300 microversion: 2.1 time: 0.085768 Aug 24 15:52:52.398605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 473/917] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:52 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:52.498957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:52.499493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:52.505560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.506209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.506658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.507359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.507839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.508268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.637902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:52.638163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:52.648265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.648912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.649414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.650829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.651382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.651778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.667355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:52.678656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3dccb7a7-4a8d-478a-a242-47aa404bed57 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1757 microversion: 2.1 time: 0.185569 Aug 24 15:52:52.679443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 445/918] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:52.812803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:52.815381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:52.825355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d15b364-875b-4754-bf0d-900509645feb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1732 microversion: 2.1 time: 0.193744 Aug 24 15:52:52.826028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 474/919] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:52.830867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:52.833811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:52.841156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.841875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.842467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.843332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.843962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.844556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.846327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:52.846821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:52.856016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.856468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.856905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.857615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:52.858069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:52.858496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:52.880104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0d15961d-92a0-46ca-b22d-fd2f40d075d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053201 Aug 24 15:52:52.881144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 446/920] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:52.957174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b73732c-efc5-4d62-b1c7-a177064e3b9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114559 Aug 24 15:52:52.958034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 475/921] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 15:52:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:53.357124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:53.359527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:53.366670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:53.367507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:53.368008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:53.369437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:53.370306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:53.370791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:53.406146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dbaa191b-513a-484d-968f-963000f5f69d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053190 Aug 24 15:52:53.407223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 447/922] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:53.421238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:53.422801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:53.430466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:53.431951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:53.432836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:53.433812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:53.434507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:53.435148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:53.702648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:53.703693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:53.710820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:53.711716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:53.712457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:53.713874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:53.716206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:53.716754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.026318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:54.034856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e1d9b23d-2654-4665-850c-853d45f4f966 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.618571 Aug 24 15:52:54.035530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 476/923] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:53 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:54.040497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:54.043060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:54.049836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:54.050420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:54.051144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.051802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:54.052391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:54.052911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.073458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:54.083254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9f2ad99-03d2-4989-a63b-01edbda5dd1e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.386294 Aug 24 15:52:54.088250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-81aab6e4-e663-4ae1-b123-aeb97a512ffd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050902 Aug 24 15:52:54.093243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 477/924] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:54.100395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 448/925] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:54.341773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-e5de0944-9c05-4089-84f2-601edf983ea9 req-73a54542-da90-4e76-95f3-84eea3206fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:54.342334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-656b9e2f-bf77-4591-8a74-dbec8518e21a req-db327308-af87-4747-acc0-16334a585d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecbec13-9cc8-431d-b58e-61f8f2a845aa", "tag": "836ca65e-50ee-4a22-ac89-56fd03420b9b"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:54.363259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e5de0944-9c05-4089-84f2-601edf983ea9 req-73a54542-da90-4e76-95f3-84eea3206fcd service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:54.364323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e5de0944-9c05-4089-84f2-601edf983ea9 req-73a54542-da90-4e76-95f3-84eea3206fcd service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:54.368471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e5de0944-9c05-4089-84f2-601edf983ea9 req-73a54542-da90-4e76-95f3-84eea3206fcd service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.374383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-656b9e2f-bf77-4591-8a74-dbec8518e21a req-db327308-af87-4747-acc0-16334a585d9f service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:54.375260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-656b9e2f-bf77-4591-8a74-dbec8518e21a req-db327308-af87-4747-acc0-16334a585d9f service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:54.376051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-656b9e2f-bf77-4591-8a74-dbec8518e21a req-db327308-af87-4747-acc0-16334a585d9f service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.388975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-e5de0944-9c05-4089-84f2-601edf983ea9 req-73a54542-da90-4e76-95f3-84eea3206fcd service nova] Creating event network-changed:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 15:52:54.395954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-e5de0944-9c05-4089-84f2-601edf983ea9 req-73a54542-da90-4e76-95f3-84eea3206fcd service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062359 Aug 24 15:52:54.397330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 478/926] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:54.398834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-656b9e2f-bf77-4591-8a74-dbec8518e21a req-db327308-af87-4747-acc0-16334a585d9f service nova] Creating event network-changed:836ca65e-50ee-4a22-ac89-56fd03420b9b for instance aecbec13-9cc8-431d-b58e-61f8f2a845aa on hv-cinder-84932 Aug 24 15:52:54.407657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-656b9e2f-bf77-4591-8a74-dbec8518e21a req-db327308-af87-4747-acc0-16334a585d9f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072568 Aug 24 15:52:54.408723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 449/927] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:54.426383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:54.431282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:54.443619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:54.444540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:54.445340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.446612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:54.447998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:54.448795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:54.509357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-915a2611-7756-4e40-98e0-f719c080c9d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091709 Aug 24 15:52:54.510419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 479/928] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:55.056896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:55.064497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:55.072365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.073257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.074087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.075194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.075759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.076437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.103990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:55.106985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:55.115815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.116971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.117513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.118515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.119339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.120117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.158894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7658ec8-b59f-4bbc-a60a-5802a468c9a7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062155 Aug 24 15:52:55.160490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 480/929] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:55.167068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:55.168005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:55.174133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.174711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.175223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.176068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.176591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.177108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.285318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:55.294231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8246a797-f495-453f-8387-978919c885f3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.241829 Aug 24 15:52:55.295822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 450/930] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:55 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:55.348023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:55.356915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-37a29b2b-3d4c-4333-a143-55bd97516b4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.194357 Aug 24 15:52:55.360583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 481/931] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:55.522172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:55.524516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:55.531722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.532213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.532701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.533338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:55.533819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:55.534251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:55.536751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:55.566508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5fbb7cba-8f8d-456c-baf4-7ab775677e3c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048312 Aug 24 15:52:55.567072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 451/932] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:56.172290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:56.174564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:56.181121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.182151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.182591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.183294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.183797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.184229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.217717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ee83273-8bf2-4051-a365-e584e9094614 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049394 Aug 24 15:52:56.218302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 482/933] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:56.315006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:56.315623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:56.321759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.322855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.323303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.324037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.324495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.324921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.378388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:56.378998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:56.380964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=4 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:56.388704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.389512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.390163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.390978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.391661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.392329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.534052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:56.543232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a1339a29-7922-4d81-9865-6002124394e0 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.232017 Aug 24 15:52:56.543837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 452/934] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:56 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:56.548432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-cf0995d8-9ee7-4efd-8d7f-55fb140fcc70 req-8d626055-fee6-4599-a13b-c58b58463433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:56.558624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cf0995d8-9ee7-4efd-8d7f-55fb140fcc70 req-8d626055-fee6-4599-a13b-c58b58463433 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.559110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cf0995d8-9ee7-4efd-8d7f-55fb140fcc70 req-8d626055-fee6-4599-a13b-c58b58463433 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.559546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cf0995d8-9ee7-4efd-8d7f-55fb140fcc70 req-8d626055-fee6-4599-a13b-c58b58463433 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.571249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-cf0995d8-9ee7-4efd-8d7f-55fb140fcc70 req-8d626055-fee6-4599-a13b-c58b58463433 service nova] Creating event network-changed:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 15:52:56.577677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-cf0995d8-9ee7-4efd-8d7f-55fb140fcc70 req-8d626055-fee6-4599-a13b-c58b58463433 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032137 Aug 24 15:52:56.578530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 453/935] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:56.578668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:56.585786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:56.588617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ef3d72dc-c9cf-43bd-89b0-246d1f1cbe0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.214051 Aug 24 15:52:56.589233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 483/936] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:56.589651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:56.599872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.600893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.601495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.602205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:56.602793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:56.604104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:56.634259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-639e5441-65f8-40bb-a9b4-e9f319ebf3ee tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054080 Aug 24 15:52:56.635401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 454/937] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:57.230156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:57.232393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:57.238733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.239209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.239663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.240349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.240798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.241218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.272185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-be1019c2-e68a-42eb-a974-acdf95c1d972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Aug 24 15:52:57.272665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 484/938] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:57.563990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:57.564551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:57.570993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.571480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.572530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.573394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.573849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.574360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.610509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:57.611125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:57.619990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.620737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.621185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.621910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.622432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.622809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.762272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:57.769973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-132a15f2-253a-4ef3-aa82-eaa72b17e19f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.210036 Aug 24 15:52:57.770585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 455/939] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:57 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:57.776647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:57.778843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:57.784729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.785229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.785668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.786379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:57.786991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:57.787425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:57.807142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:57.815170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-32cf37f4-1a17-4509-b596-4683d11c5706 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.208409 Aug 24 15:52:57.815686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 485/940] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:57.818319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-37ce1859-4baa-499f-be81-e007f4316a7b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046625 Aug 24 15:52:57.819064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 456/941] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:58.283658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:58.285860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:58.293041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.293530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.293971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.294676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.295164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.295590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.325626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9a30f0e4-3d96-43b9-ab44-62436f5dcc20 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Aug 24 15:52:58.326192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 486/942] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:58.791526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:58.792167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:58.798471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.798950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.799378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.800089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.800536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.800954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.830627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:58.833194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:58.839831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.840329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.840767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.841479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.841942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.842370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.874187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b35b9287-1e05-47a3-b31d-a6a7a82872dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047545 Aug 24 15:52:58.874747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 487/943] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:52:58.878295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:58.879347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:58.879979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:58.886563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.887047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.887500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.888232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:58.888682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:58.889105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:58.965209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:58.974316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-015e89ec-1059-4b93-b322-72584de00e35 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.187179 Aug 24 15:52:58.975457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 457/944] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:58 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:59.061801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:59.070393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-657bc87e-75c7-4898-b5cd-667a04539372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.194602 Aug 24 15:52:59.070979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 488/945] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:59.338964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:59.341136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:59.343042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=8 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:59.348481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:59.348969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:59.349399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:59.350095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:59.350546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:59.350965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:59.382098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f7014313-cfb5-4fc6-8dcf-0829667d9135 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Aug 24 15:52:59.382666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 458/946] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:52:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:52:59.887190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:59.889387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:59.895973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:59.896459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:59.896889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:59.897584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:59.898037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:59.898460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:59.932693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc88c9c2-b728-45d2-90c5-862ac1a3271e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049807 Aug 24 15:52:59.933293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 489/947] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:52:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:52:59.997218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:59.997833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:00.004198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.004674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.005103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.005788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.006232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.006678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.093370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:00.093992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:00.102763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.103188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.103640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.105594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.106242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.106729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.148798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:00.157366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-276c76a8-7851-4f32-9f94-b55e69a94d2f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.164030 Aug 24 15:53:00.157970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 459/948] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:52:59 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:53:00.263696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:00.272263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-755bceb1-89d7-490d-9846-6e3df8172554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.182919 Aug 24 15:53:00.272725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 490/949] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:53:00.394528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:00.396741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:00.403305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.403831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.404270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.404967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.405422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.405852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.438270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f89d900c-384b-43f6-a0b7-f433d6dd6640 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047830 Aug 24 15:53:00.438835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 460/950] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:00.945733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:00.948561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:00.954972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.955559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.956034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.956745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:00.957209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:00.957639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:00.989959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b118b671-5403-4d6f-aff3-1b40f19ee2d7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048142 Aug 24 15:53:00.990541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 491/951] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:01.178319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:01.178948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:01.186266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.186773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.187219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.188132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.188471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.188900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.205467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:01.214505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-e19dbf46-ee8d-4ef3-a64b-06498e8616c6 req-8b56b3a8-e400-4537-9517-0121e3b4e1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecbec13-9cc8-431d-b58e-61f8f2a845aa", "name": "network-vif-plugged", "status": "completed", "tag": "836ca65e-50ee-4a22-ac89-56fd03420b9b"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:53:01.224814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-e19dbf46-ee8d-4ef3-a64b-06498e8616c6 req-8b56b3a8-e400-4537-9517-0121e3b4e1ab service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.225155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-e19dbf46-ee8d-4ef3-a64b-06498e8616c6 req-8b56b3a8-e400-4537-9517-0121e3b4e1ab service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.225518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-e19dbf46-ee8d-4ef3-a64b-06498e8616c6 req-8b56b3a8-e400-4537-9517-0121e3b4e1ab service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.346706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:01.355504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2cd63292-e1ed-4f81-bd46-613139e11bc8 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.180917 Aug 24 15:53:01.356125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 492/952] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:01 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:53:01.360845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:01.361382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:01.367779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.368552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.369634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.370353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.372079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.372079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.393692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-e19dbf46-ee8d-4ef3-a64b-06498e8616c6 req-8b56b3a8-e400-4537-9517-0121e3b4e1ab service nova] Creating event network-vif-plugged:836ca65e-50ee-4a22-ac89-56fd03420b9b for instance aecbec13-9cc8-431d-b58e-61f8f2a845aa on hv-cinder-84932 Aug 24 15:53:01.398944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-e19dbf46-ee8d-4ef3-a64b-06498e8616c6 req-8b56b3a8-e400-4537-9517-0121e3b4e1ab service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256292 Aug 24 15:53:01.399537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 461/953] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:01.451192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:01.454007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:01.461583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.462120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.462553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.463316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:01.463943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:01.464367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:01.496641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b50647d-d01f-4051-aa0e-26fe475f6c2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049861 Aug 24 15:53:01.497211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 462/954] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:01.531044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:01.539276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aeca8772-6599-49d6-843c-22057c26c4a2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.182200 Aug 24 15:53:01.539887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 493/955] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:02.003979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:02.005962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:02.012124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.012607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.013037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.013724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.014171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.014581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.044589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-659d203b-17ef-4e74-8bb9-0c73b65d5f62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044661 Aug 24 15:53:02.045149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 463/956] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:02.376836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:02.377370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:02.383940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.384950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.385889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.386597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.387063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.387495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.508360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:02.510679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:02.517069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.517555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.517983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.518679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.519126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.519544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.522248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:02.530055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dcea5637-d72c-47d2-a37a-0467fbdb72e3 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1366 microversion: 2.1 time: 0.157151 Aug 24 15:53:02.530723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 494/957] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:02 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:02.549049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-43578ee7-4982-4f68-b94e-5291d4a17453 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 24 15:53:02.549588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 464/958] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:02.561552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:02.562158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:02.568056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.568540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.568976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.569673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:02.570130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:02.570555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:02.716165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:02.725506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-62c461a2-3a3a-4ed3-84e0-a3374806e5ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.167718 Aug 24 15:53:02.726091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 495/959] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:03.057136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:03.059403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:03.066286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.066774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.067207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.067951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.068401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.068822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.103773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-36962bb4-c92d-4ab9-b458-3d30a1e78b06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050714 Aug 24 15:53:03.104377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 465/960] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:03.555373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:03.556809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:03.563375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:03.565732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:03.566051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.566591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.567089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.567960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.568928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.569241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.572974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.573525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.573968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.574675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.575131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.575570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.607099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7447330b-e0b5-4209-b2e0-db012fe104a5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048324 Aug 24 15:53:03.607887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 466/961] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:03.703931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:03.712501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ccc84275-9ddf-496c-b94e-71eb9d4e65e1 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1553 microversion: 2.1 time: 0.163472 Aug 24 15:53:03.713191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 496/962] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:03 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:03.732814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:03.733310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:03.739344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.739892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.740325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.741078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.741489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.741915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.749750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:03.750818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:03.761125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.761928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.762662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.763863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:03.764639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:03.765372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:03.826933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9178fb75-a792-4aab-aed9-21bca5497b0f tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098353 Aug 24 15:53:03.827522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 467/963] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 15:53:03 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:04.075729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:04.084143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fd755ad5-e7f7-4d6a-8779-6a5145d69e85 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.341281 Aug 24 15:53:04.084714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 497/964] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:04.116847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:04.119211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:04.125481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:04.125972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:04.126411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:04.127240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:04.127590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:04.128027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:04.163165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f81f4c5-ffb8-4809-8c71-a55432db1180 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050156 Aug 24 15:53:04.168868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 468/965] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:04.618793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:04.621066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:04.627763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:04.628255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:04.628695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:04.629397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:04.629852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:04.630279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:04.661790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-45269d1f-5c07-429a-b960-d289ad134474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 Aug 24 15:53:04.662574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 498/966] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:04.868745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-cc408693-2be6-45d3-b355-cb2ee3c3cc68 req-6b8a6e98-8b86-4320-89d0-b238e70545da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecbec13-9cc8-431d-b58e-61f8f2a845aa", "tag": "836ca65e-50ee-4a22-ac89-56fd03420b9b"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:53:04.879719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cc408693-2be6-45d3-b355-cb2ee3c3cc68 req-6b8a6e98-8b86-4320-89d0-b238e70545da service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:04.880215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cc408693-2be6-45d3-b355-cb2ee3c3cc68 req-6b8a6e98-8b86-4320-89d0-b238e70545da service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:04.880650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cc408693-2be6-45d3-b355-cb2ee3c3cc68 req-6b8a6e98-8b86-4320-89d0-b238e70545da service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:04.893153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-cc408693-2be6-45d3-b355-cb2ee3c3cc68 req-6b8a6e98-8b86-4320-89d0-b238e70545da service nova] Creating event network-changed:836ca65e-50ee-4a22-ac89-56fd03420b9b for instance aecbec13-9cc8-431d-b58e-61f8f2a845aa on hv-cinder-84932 Aug 24 15:53:04.898206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-cc408693-2be6-45d3-b355-cb2ee3c3cc68 req-6b8a6e98-8b86-4320-89d0-b238e70545da service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 Aug 24 15:53:04.898796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 469/967] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:05.106595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:05.107209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:05.113132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:05.113618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:05.114050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:05.114760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:05.115204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:05.115807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:05.177822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:05.180969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:05.190117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:05.190844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:05.191485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:05.192475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:05.196060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:05.196787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:05.202305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:05.240216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c7fa8d87-ed26-4896-9d40-c7668eef6f0d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067031 Aug 24 15:53:05.246305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 470/968] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:05.345825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:05.355269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ef5bf553-4901-4509-926a-95a54096b2df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.252539 Aug 24 15:53:05.356219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 499/969] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:05.674735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:05.676790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:05.682818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:05.683305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:05.683762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:05.684465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:05.684916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:05.685336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:05.716240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60c9ffcd-24ab-4af0-bc37-10c0e243b9e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Aug 24 15:53:05.716810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 471/970] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:06.253469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:06.255738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:06.262916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:06.263402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:06.263866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:06.264565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:06.265015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:06.265434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:06.296418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0cec8ff8-9413-48d8-a24d-ed4220db5d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047041 Aug 24 15:53:06.296967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 500/971] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:06.376277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:06.376910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:06.383271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:06.383791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:06.384229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:06.385432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:06.385887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:06.386305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:06.533102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:06.541574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a3206ca3-237e-410a-8ee5-5bc48f764e33 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.169095 Aug 24 15:53:06.542172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 472/972] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:06.727668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:06.729882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:06.736039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:06.736525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:06.736964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:06.737662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:06.738118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:06.738541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:06.769515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-056fe6ad-fb0d-4964-94d6-cde0d4a6bb2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 Aug 24 15:53:06.770098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 501/973] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:07.312341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:07.314583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:07.321352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:07.321920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:07.323449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:07.324593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:07.325323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:07.325781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:07.355430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-64bc3128-ed97-48cf-9f47-3f946fbdb6ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049636 Aug 24 15:53:07.356355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 473/974] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:07.563311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:07.564062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:07.566500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:07.572166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:07.572676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:07.573120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:07.573834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:07.574297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:07.574727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:07.726482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:07.735860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ade192b2-eea4-4afe-a079-c3419da380cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.176516 Aug 24 15:53:07.736440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 502/975] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:07.781667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:07.783926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:07.790310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:07.791311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:07.791907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:07.792703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:07.793160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:07.793582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:07.822903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6bd29fae-3a8f-430f-b0fd-9903850490ab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Aug 24 15:53:07.823463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 474/976] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:08.368662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:08.371297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:08.377383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:08.377867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:08.378302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:08.378994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:08.379442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:08.379897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:08.411665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8564cd36-a1d0-4086-8619-d5a5a982b937 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047334 Aug 24 15:53:08.412247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 503/977] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:08.758382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:08.759015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:08.765932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:08.766446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:08.766876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:08.767595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:08.768194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:08.768614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:08.835643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:08.837855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:08.844386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:08.844873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:08.845407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:08.846250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:08.846834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:08.846834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:08.878379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee78ebbe-1848-4c50-8a23-7aa9512bde47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046892 Aug 24 15:53:08.878955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 504/978] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:08.913604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:08.921725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-75469513-4d99-4795-93f2-e0207bab323f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.167208 Aug 24 15:53:08.922581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 475/979] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:09.424829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:09.426980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:09.432935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:09.433595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:09.434054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:09.434753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:09.435208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:09.435717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:09.465429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3099730d-ea6f-4001-bc85-8cc10de653fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043787 Aug 24 15:53:09.465782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 505/980] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:09.891543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:09.893768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:09.896170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:09.901297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:09.901781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:09.903174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:09.903931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:09.904471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:09.904827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:09.940248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-666b437c-517a-47fa-9966-4e089144271a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053510 Aug 24 15:53:09.941056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 476/981] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:09.944601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:09.945203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:09.952288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:09.952768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:09.953192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:09.953879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:09.954351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:09.954771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:10.335616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:10.344658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7be8b6a-9859-4579-91fe-36d408b87d7c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.404104 Aug 24 15:53:10.345222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 506/982] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:10.477671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:10.479911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:10.486479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:10.486960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:10.487396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:10.488112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:10.488564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:10.488986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:10.518403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5fee134e-c65b-4eb4-9b5a-0f1ecc309741 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044720 Aug 24 15:53:10.518959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 477/983] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:10.953223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:10.955449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:10.962332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:10.962818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:10.963248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:10.963975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:10.964492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:10.965043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:10.993801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-babf8265-5e15-4445-9fde-534ceba12b4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Aug 24 15:53:10.994355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 507/984] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:11.366323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:11.367001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:11.374083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:11.374570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:11.375013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:11.375747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:11.376205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:11.376642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:11.520405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:11.529280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d36e72f-ff52-4e72-a4b1-9a52db948b9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.166812 Aug 24 15:53:11.529843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 478/985] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:11.530522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:11.532685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:11.538661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:11.539146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:11.539580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:11.540322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:11.540752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:11.541173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:11.571160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a1a3df4f-a4b5-4c29-9c47-72e2f8fb8104 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044708 Aug 24 15:53:11.571738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 508/986] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:12.007453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:12.009586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:12.016143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:12.016616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:12.017052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:12.017739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:12.018188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:12.018609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:12.048790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-370efbc4-0e61-4e1f-a023-e628c02fbf5e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Aug 24 15:53:12.049341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 479/987] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:12.550284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:12.550924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:12.557347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:12.557828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:12.559024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:12.559775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:12.560231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:12.560654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:12.563147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:12.584392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:12.586523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:12.593407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:12.593900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:12.594341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:12.595043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:12.595501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:12.595956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:12.628894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b19b7e7f-c105-4f55-9bdd-fc062ec6dee3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048657 Aug 24 15:53:12.629472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 480/988] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:12.715579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:12.723755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9082da67-de9e-4165-9d65-94c36f9a64e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.177315 Aug 24 15:53:12.724319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 509/989] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:13.061538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:13.064071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:13.069997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:13.070484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:13.070922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:13.071619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:13.072100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:13.072524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:13.102050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d5309275-8b00-4e46-92ec-1a049562a129 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Aug 24 15:53:13.102604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 481/990] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:13.641715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:13.643919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:13.650318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:13.650810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:13.651250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:13.652626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:13.653159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:13.653514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:13.684138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f5986636-2579-428b-83a9-e7ae51035646 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046725 Aug 24 15:53:13.684698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 510/991] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:13.744956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:13.745475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:13.752129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:13.752612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:13.753047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:13.753737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:13.754188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:13.754611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:13.898626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:13.907915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dd410671-8544-46bf-95db-3f476bfbb07e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1762 microversion: 2.1 time: 0.166977 Aug 24 15:53:13.908512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 482/992] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1762 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:14.114442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:14.116914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:14.123174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:14.123677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:14.124113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:14.124801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:14.125251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:14.125669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:14.157035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2f8942a1-1e06-4045-8e8c-874a4210b73e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Aug 24 15:53:14.157604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 511/993] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:14.696690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:14.698974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:14.707129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:14.707622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:14.708083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:14.709048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:14.709502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:14.709927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:14.739976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e77b863-78ee-4d9a-ab77-5b0ec40690f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047341 Aug 24 15:53:14.740451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 483/994] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:14.928958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:14.929714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:14.936853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:14.937332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:14.937769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:14.938473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:14.938932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:14.939353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:15.092854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:53:15.101805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bcb063ee-374e-4d93-a8a0-8a667431e0ab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1765 microversion: 2.1 time: 0.176682 Aug 24 15:53:15.102379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 512/995] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:53:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1765 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:53:15.170256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:15.172440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:15.178733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:15.179209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:15.179673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:15.180346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:15.180790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:15.181207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:15.210125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d8f5edec-4501-429d-8b7f-e4e3f2ccd85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Aug 24 15:53:15.210668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 484/996] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:15.752058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:15.754144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:15.760329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:15.760820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:15.761257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:15.762496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:15.762970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:15.763395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:15.792851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4e72e349-2370-4bbc-bd20-14e679c5f86c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044879 Aug 24 15:53:15.793429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 513/997] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:16.223303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:16.225521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:16.232974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:16.233460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:16.234461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:16.234786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:16.235620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:16.236444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:16.274928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b4be74c1-35a5-446a-88f5-db6a16f3047d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055928 Aug 24 15:53:16.275498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 485/998] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:16.805709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:16.807793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:16.815983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:16.816482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:16.816926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:16.817708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:16.818133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:16.818563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:16.856996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-68eacd59-b0bf-40fc-984d-039d9c9bc044 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055304 Aug 24 15:53:16.857588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 514/999] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:17.287947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:17.290096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:17.296557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:17.297041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:17.297475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:17.298174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:17.298623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:17.299047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:17.323941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:17.329961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-17224891-1780-4dfb-ade4-d2ec0f064006 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Aug 24 15:53:17.330540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 486/1000] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:17.869839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:17.872704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:17.879085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:17.879568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:17.880037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:17.880737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:17.881190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:17.881610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:17.910440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-52a30648-107f-4586-9a7e-842abe522f32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044598 Aug 24 15:53:17.910999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 515/1001] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:18.343456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:18.345618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:18.352017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:18.352505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:18.352947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:18.353643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:18.354099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:18.354534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:18.384869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-af3bd45e-68c5-4e91-87aa-567e28ac4778 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Aug 24 15:53:18.385426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 487/1002] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:18.923013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:18.925397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:18.932707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:18.933200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:18.934179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:18.934948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:18.935405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:18.935866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:18.965928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d579a5b2-a4c8-4c7d-ab83-6c60ca41a1ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047130 Aug 24 15:53:18.966488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 516/1003] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:19.397948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:19.400139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:19.406644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:19.407139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:19.407573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:19.408301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:19.408758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:19.409183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:19.438667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5dab4a74-dc11-4e0b-ab18-d195f8439e44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 24 15:53:19.439225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 488/1004] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:19.978357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:19.981175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:19.987679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:19.988174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:19.988615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:19.989317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:19.989778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:19.990207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:20.020862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2b52b0df-c7f0-471e-b2a2-b179091c8604 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046457 Aug 24 15:53:20.021428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 517/1005] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:20.454213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:20.456427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:20.462708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:20.463193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:20.463652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:20.464347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:20.465035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:20.465684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:20.494609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-08426391-39aa-46a1-8a18-b186db61b386 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Aug 24 15:53:20.495162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 489/1006] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:21.033817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:21.036035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:21.042522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:21.043621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:21.044124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:21.044848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:21.045308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:21.045736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:21.075373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf93ff37-11e0-4acc-be2f-8c2f89f5d7dc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045483 Aug 24 15:53:21.075959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 518/1007] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:21.506620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:21.508784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:21.515877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:21.516364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:21.516800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:21.517498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:21.517953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:21.518379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:21.548326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c25d45e0-6e86-4dab-90f3-36e5a67c4dae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045708 Aug 24 15:53:21.548882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 490/1008] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:22.087180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:22.089365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:22.095967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:22.096443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:22.096874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:22.097609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:22.098007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:22.098424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:22.128314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-567775ec-5db0-447a-8205-2b636d96a9a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045355 Aug 24 15:53:22.128867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 519/1009] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:22.560854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:22.562920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:22.569334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:22.569811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:22.570246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:22.570939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:22.571390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:22.571853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:22.601202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-181fb871-64ec-4454-a6c5-2de4f9539fe8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Aug 24 15:53:22.601756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 491/1010] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:23.141258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:23.143848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:23.151362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:23.151881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:23.153224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:23.154531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:23.155098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:23.155541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:23.194758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-225fdf76-0dde-4a10-922e-2d8d9e234024 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057999 Aug 24 15:53:23.195321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 520/1011] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:23.614198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:23.616402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:23.623619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:23.624133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:23.624569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:23.625276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:23.625724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:23.626146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:23.655996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f900e1aa-12f7-4d72-9225-6b65805582e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Aug 24 15:53:23.656554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 492/1012] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:24.208319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:24.210740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:24.217864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:24.218354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:24.218793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:24.219493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:24.219993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:24.220428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:24.250543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a6663f09-d470-4cc4-8dca-159e4933a0c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046231 Aug 24 15:53:24.251148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 521/1013] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:24.668305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:24.670446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:24.676850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:24.677322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:24.677752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:24.678433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:24.678879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:24.679293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:24.708477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ab686d31-96f2-4823-8c6f-1f7392215ef3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Aug 24 15:53:24.709033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 493/1014] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:25.263548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:25.265741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:25.272261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:25.272751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:25.273192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:25.273898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:25.274356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:25.274786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:25.307516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b1c0c39-c684-42a0-a9c1-3acd35f4b88d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048377 Aug 24 15:53:25.308013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 522/1015] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:25.721829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:25.723978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:25.730305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:25.731437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:25.732086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:25.732775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:25.733225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:25.733647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:25.761976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ed5522dc-b5c3-4c71-abdd-3fd88b4c87f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Aug 24 15:53:25.762528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 494/1016] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:26.320800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:26.323586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:26.331366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:26.331896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:26.332338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:26.333037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:26.333498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:26.333926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:26.364120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-703858bb-cac7-4788-a79f-050cdf1678f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047321 Aug 24 15:53:26.364674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 523/1017] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:26.774747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:26.776976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:26.783545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:26.784062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:26.784501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:26.785192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:26.785648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:26.786073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:26.819750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb5cbdaf-4c99-4c1f-9885-9be458758df8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048749 Aug 24 15:53:26.824172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 495/1018] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:27.377502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:27.379555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:27.385622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:27.386096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:27.386527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:27.388450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:27.389016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:27.389440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:27.419707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71281e95-d004-46a9-8d7a-abc56cdc2bfa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046602 Aug 24 15:53:27.420259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 524/1019] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:27.832082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:27.834252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:27.842009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:27.842517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:27.842958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:27.843697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:27.844162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:27.844587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:27.885801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1abb0e15-03da-4cb1-a6d8-f389e06acbc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050747 Aug 24 15:53:27.886450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 496/1020] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:28.431374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:28.434360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:28.440813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:28.441287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:28.441718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:28.442401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:28.442849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:28.443268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:28.467859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:28.475050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-46dec849-c52b-4121-9b42-a7aefce562d0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047673 Aug 24 15:53:28.475624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 525/1021] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:28.898294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:28.900525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:28.908896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:28.909761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:28.910540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:28.911802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:28.912629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:28.913316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:28.945022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6adb66d4-152b-4737-bdde-2dc5d34193e7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050522 Aug 24 15:53:28.945578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 497/1022] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:29.486581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:29.488822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:29.495187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:29.495698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:29.496681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:29.497557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:29.498012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:29.498437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:29.528963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3d2b819d-7747-47f2-a2d8-847949ca3d2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046314 Aug 24 15:53:29.529532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 526/1023] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:29.958833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:29.961489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:29.968235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:29.968720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:29.969153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:29.969848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:29.970300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:29.970730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:30.001210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9f90d56c-e0b7-45b3-9dee-146354d761d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046461 Aug 24 15:53:30.001777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 498/1024] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:30.541475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:30.543687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:30.550630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:30.551122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:30.551567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:30.552298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:30.552762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:30.553192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:30.583906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1a81dbbf-e243-4d5d-b6bc-2b9abf88bf40 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046299 Aug 24 15:53:30.584474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 527/1025] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:31.014449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:31.016681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:31.023072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:31.023560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:31.024033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:31.024723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:31.025182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:31.025608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:31.054982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-55d65cc8-8bbc-448a-905b-3bcda99e423b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Aug 24 15:53:31.055536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 499/1026] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:31.597498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:31.599734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:31.606189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:31.606676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:31.607796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:31.608492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:31.608948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:31.609372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:31.638097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6013fd44-cbda-47cb-81d2-77ab70576d45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Aug 24 15:53:31.638656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 528/1027] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:32.066442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:32.068617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:32.075007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:32.076051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:32.077160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:32.077870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:32.078329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:32.078763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:32.109126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-39872104-ab4a-4ed6-9e43-adf00cb9ffbe tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Aug 24 15:53:32.109608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 500/1028] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:32.650244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:32.652406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:32.658944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:32.659428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:32.659898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:32.660587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:32.661035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:32.661454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:32.690970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fbc42fa1-2f05-4845-a499-1e7e774f2e20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044727 Aug 24 15:53:32.691522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 529/1029] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:33.121409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:33.124302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:33.130581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:33.131071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:33.131520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:33.132241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:33.132700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:33.133128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:33.164513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-15446621-f94a-4f42-ab02-02df97bc7dd1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047018 Aug 24 15:53:33.165077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 501/1030] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:33.703128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:33.705337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:33.712135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:33.712620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:33.713055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:33.713752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:33.714206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:33.714629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:33.744587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c074d46f-6d76-4eed-a3bb-da7d0c8d4e60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045935 Aug 24 15:53:33.745147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 530/1031] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:34.275496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:34.277762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:34.284226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:34.284713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:34.285151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:34.285850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:34.286309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:34.286768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:34.318454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e76414c-9473-4e03-b51b-df1129c27f21 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145497 Aug 24 15:53:34.319028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 502/1032] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:34.757705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:34.759917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:34.766328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:34.766814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:34.767245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:34.767962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:34.768417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:34.768840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:34.798922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a23dfe46-9707-4537-8625-04ac84f3bd09 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045163 Aug 24 15:53:34.799493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 531/1033] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:35.254705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:35.255203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:35.261542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.262028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.262465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.263440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.264394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.264828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.279924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:35.330714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:35.332910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:35.339327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.339959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.340565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.341807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.342367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.342800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.348167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lazy-loading 'services' on Instance uuid c5e42f6c-3744-4979-9c73-20f918be2be6 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:53:35.373224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6ca5816a-bc03-4410-aa4b-f2f1b472f997 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Aug 24 15:53:35.373615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 532/1034] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:35.422763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b71a8a7b-da5a-4ec6-b8db-1e3ec4f4b6cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments/d8aec088-688d-4945-8094-a0d52efe81b3" status: 202 len: 0 microversion: 2.1 time: 0.171792 Aug 24 15:53:35.423573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 503/1035] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:53:35 2022] DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments/d8aec088-688d-4945-8094-a0d52efe81b3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:53:35.431910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:35.434144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:35.441100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.441600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.442038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.442751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.443215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.443665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.475935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dadeedb7-c802-4dcd-a6da-1c9f10808e29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Aug 24 15:53:35.476509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 533/1036] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:35.812604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:35.814793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:35.821056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.821543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.821985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.822697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:35.823152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:35.823581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:35.855753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6737d9bd-4b16-40ac-960d-11544f7a47d9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048013 Aug 24 15:53:35.856330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 504/1037] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:36.385509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:36.387700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:36.394479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:36.395078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:36.395519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:36.396249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:36.396707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:36.397133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:36.427611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3ce6acf8-c12d-4bd3-8aae-1c2d5efbc643 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Aug 24 15:53:36.428200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 534/1038] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:36.489303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:36.491468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:36.498241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:36.499011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:36.499248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:36.499979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:36.500429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:36.500851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:36.529898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-63590aa8-e485-439c-8186-de8c1596aefe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 24 15:53:36.530449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 505/1039] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:36.868185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:36.870329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:36.876972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:36.877470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:36.878011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:36.878775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:36.879232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:36.879731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:36.915647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9342e8f9-94eb-4635-ba6a-ba452149ec5d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051426 Aug 24 15:53:36.916262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 535/1040] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:37.439150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:37.441329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:37.447265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:37.447787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:37.448229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:37.448919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:37.449372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:37.449796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:37.479461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3be70a74-646c-484d-8ecc-e5513c96cf73 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Aug 24 15:53:37.480040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 506/1041] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:37.542082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:37.544284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:37.550704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:37.551186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:37.551615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:37.552327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:37.552777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:37.553198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:37.582816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-41316e54-165c-461e-a10e-e27a10970507 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 24 15:53:37.583369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 536/1042] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:37.929316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:37.931737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:37.938853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:37.939343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:37.939818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:37.940526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:37.940973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:37.941395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:37.975196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-261db91f-a28d-4ac7-8eb2-5493ff65ea3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049871 Aug 24 15:53:37.975793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 507/1043] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:38.492144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:38.494289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:38.496174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=70 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:38.501582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:38.502067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:38.502501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:38.503193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:38.503672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:38.504102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:38.533676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5066234b-7e61-4bb6-a439-62b61580771c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Aug 24 15:53:38.534233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 537/1044] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:38.594884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:38.597055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:38.602913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:38.603398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:38.603871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:38.604566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:38.605019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:38.605468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:38.637853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0182c06c-587f-4029-afcc-b29a8ec3196c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Aug 24 15:53:38.638970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 508/1045] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:38.988261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:38.990422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:38.996944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:38.998016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:38.998904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:38.999614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:39.000105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:39.000533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:39.031821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4f1684b9-d321-4d8d-9d1b-c80bd7a5cbc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047581 Aug 24 15:53:39.032390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 538/1046] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:39.546985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:39.549077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:39.555504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:39.556025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:39.556465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:39.557162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:39.557614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:39.558038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:39.588164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-176e78b5-82bc-4ce7-b27b-1a7fe80e7c6e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Aug 24 15:53:39.588732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 509/1047] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:39.650697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:39.652908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:39.659084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:39.659573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:39.660054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:39.660750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:39.661205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:39.661635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:39.692947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9257d5b5-f572-42bc-8686-6a0412b83488 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Aug 24 15:53:39.693489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 539/1048] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:40.044289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:40.047074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:40.049137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=68 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:40.054586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:40.055077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:40.055517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:40.056245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:40.056700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:40.057126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:40.086678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2d1e6a14-ebf8-44a8-9401-cf2fd23b1ee0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046342 Aug 24 15:53:40.087230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 510/1049] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:40.601747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:40.603925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:40.610303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:40.610786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:40.611359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:40.612078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:40.612549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:40.612976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:40.643207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1134d527-0ed7-4b5b-97cc-58857f23ff2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Aug 24 15:53:40.643783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 540/1050] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:40.705983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:40.708173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:40.714703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:40.715180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:40.715612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:40.716324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:40.716769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:40.717239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:40.746975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fb7f9f56-0c38-4b8b-b2e9-7404120a53ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Aug 24 15:53:40.747525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 511/1051] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:41.099904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:41.102070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:41.108138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:41.108659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:41.109099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:41.109797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:41.110256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:41.110685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:41.141634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b0f0d0f5-b27f-4124-ad2f-af43f63abebe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045479 Aug 24 15:53:41.142186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 541/1052] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:41.655744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:41.657955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:41.664071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:41.664550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:41.665012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:41.665704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:41.666148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:41.666566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:41.701617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eeed03ef-ed64-4231-bf51-2e4310035118 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050001 Aug 24 15:53:41.702185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 512/1053] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:41.758857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:41.761044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:41.767619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:41.768131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:41.768565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:41.769260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:41.769713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:41.770138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:41.783802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:41.799873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1f34ac6d-9fcd-47e3-82bc-6567040c9849 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Aug 24 15:53:41.800431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 542/1054] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:42.154160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:42.156881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:42.163222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:42.163728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:42.164167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:42.164858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:42.165309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:42.165734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:42.195042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-44f746d8-0115-46b5-8490-833e193fd914 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045007 Aug 24 15:53:42.195604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 513/1055] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:42.714145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:42.716430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:42.723123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:42.723603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:42.724066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:42.724758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:42.725215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:42.725634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:42.755645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b68ddd5-890d-40dd-8e20-609825265d44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Aug 24 15:53:42.756215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 543/1056] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:42.811893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:42.814044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:42.820032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:42.820518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:42.820954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:42.821699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:42.822156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:42.822589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:42.853272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71f2d28f-f90a-4e42-95b9-85e735333c3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046022 Aug 24 15:53:42.853832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 514/1057] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:43.207973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:43.210128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:43.216791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:43.218028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:43.218028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:43.219119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:43.219573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:43.220023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:43.248307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-847e8470-83ad-49dc-ac48-630f56c9ec57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044311 Aug 24 15:53:43.249044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 544/1058] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:43.408979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:53:43.409224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 15:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:53:43.769034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:43.771250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:43.777805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:43.778282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:43.778708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:43.779393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:43.780091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:43.780516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:43.808898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-835fe4f5-1271-4865-9031-3c2e0ce82b6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Aug 24 15:53:43.809447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 515/1059] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:43.865512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:43.867708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:43.874626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:43.875151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:43.875565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:43.876298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:43.876750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:43.877174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:43.907082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2520c465-403d-449c-ab9c-a1ee3ac1c12e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045567 Aug 24 15:53:43.907665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 545/1060] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:44.260744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:44.262885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:44.269627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:44.270116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:44.270557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:44.271261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:44.271751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:44.272185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:44.303507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4f98bec7-f7d7-4762-80c7-f7d3a89ef46a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046728 Aug 24 15:53:44.304108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 516/1061] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:44.821724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:44.824076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:44.830956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:44.831452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:44.831915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:44.832617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:44.833120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:44.833541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:44.865810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8b93bd7f-4de7-490b-9c1c-92e3302190ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048060 Aug 24 15:53:44.866376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 546/1062] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:44.919190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:44.921840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:44.928455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:44.928938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:44.929375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:44.930091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:44.930539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:44.930965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:44.961723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c5e2854b-313f-4938-8ae4-5bb129355e0e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046403 Aug 24 15:53:44.962288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 517/1063] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:45.316221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:45.318402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:45.324388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:45.324867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:45.325307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:45.325998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:45.326453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:45.326954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:45.356401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-26cf0f4b-bbe5-4736-a2ec-fa0e3bf55131 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044269 Aug 24 15:53:45.356947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 547/1064] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:45.878679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:45.880876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:45.886801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:45.887287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:45.887756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:45.888453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:45.888903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:45.889974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:45.919573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6bf53b7a-05eb-41a6-9193-53b5058d50c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Aug 24 15:53:45.920253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 518/1065] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:45.976252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:45.978414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:45.985111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:45.985593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:45.986028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:45.986727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:45.987177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:45.987601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:46.017516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-be32e7c8-6c39-4bc2-9081-99349607cd5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 Aug 24 15:53:46.018066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 548/1066] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:46.369553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:46.371713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:46.378747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:46.379231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:46.379688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:46.380386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:46.380839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:46.381261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:46.395027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:46.413899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-54579e4a-bfae-466b-8bc8-70b1120977d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048386 Aug 24 15:53:46.414473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 519/1067] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:46.932304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:46.934517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:46.940576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:46.941063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:46.941497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:46.942196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:46.942650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:46.943074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:46.973499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-befb28d0-705c-47db-81b9-d85adc60264d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Aug 24 15:53:46.974377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 549/1068] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:47.029734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:47.032553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:47.038563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:47.039040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:47.039471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:47.040188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:47.040639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:47.041053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:47.077093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f58d1688-eef1-4f9e-8e8d-efe610969652 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051263 Aug 24 15:53:47.077646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 520/1069] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:47.428953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:47.432005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:47.442117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:47.442928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:47.443624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:47.444793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:47.445576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:47.446281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:47.478988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-76341123-846c-4455-9c61-7d0ef43dabc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056637 Aug 24 15:53:47.479536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 550/1070] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:47.986345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:47.988580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:47.995023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:47.995509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:47.996054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:47.996759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:47.997216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:47.997642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.028927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4fb53974-450a-435b-99df-c83a622a238e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047016 Aug 24 15:53:48.029495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 521/1071] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:48.090729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:48.092939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:48.098926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:48.099353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:48.099820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.100508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:48.100961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:48.101383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.130538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-93853c9b-e9a6-4e62-b6a4-3007504eddb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Aug 24 15:53:48.131091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 551/1072] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:48.491044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:48.493275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:48.499161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:48.499653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:48.500110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.500811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:48.502052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:48.502483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.534826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d3b61b5e-9041-44a5-bfbf-8d74c5042077 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047697 Aug 24 15:53:48.535393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 522/1073] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:48.713676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:48.714255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:48.721070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:48.721487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:48.721916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.722608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:48.723063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:48.723482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:48.746722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5bc971b7-84c9-4f0a-b920-d67fe1556fce tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa/ips" status: 200 len: 145 microversion: 2.1 time: 0.037235 Aug 24 15:53:48.747285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 552/1074] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 15:53:48 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:49.041870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:49.044031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:49.051178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:49.051718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:49.052139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:49.052830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:49.053275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:49.053698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:49.088228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e32c64ff-1088-4473-9fdf-42201d7cc533 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050244 Aug 24 15:53:49.088795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 523/1075] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:49.143225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:49.145505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:49.151617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:49.152140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:49.152586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:49.153287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:49.153744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:49.154176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:49.183931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0824beee-a914-4372-ba22-574c8ddea367 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 24 15:53:49.184495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 553/1076] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:49.547044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:49.549778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:49.555752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:49.556241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:49.556685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:49.557383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:49.557842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:49.558271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:49.589198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b0514f3-3cdc-4a4f-a9c6-b236ae65bfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046122 Aug 24 15:53:49.589759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 524/1077] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:50.100795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:50.102945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:50.109353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:50.109841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:50.110278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:50.111178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:50.111654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:50.112091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:50.143122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b967536-a411-4b2f-8223-8ed242ef05fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Aug 24 15:53:50.143708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 554/1078] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:50.196339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:50.198489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:50.205644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:50.206141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:50.206981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:50.207710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:50.208171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:50.208601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:50.237700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c62c0c9-8696-4da6-bd66-9a576e91bf28 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 24 15:53:50.238264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 525/1079] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:50.601563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:50.603742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:50.609739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:50.610227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:50.611679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:50.612398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:50.612860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:50.613293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:50.643530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cbfc65cf-ed84-4653-abdc-ddb5e0bf300e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045929 Aug 24 15:53:50.644114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 555/1080] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:51.154587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:51.156726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:51.162766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:51.163241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:51.163697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:51.164384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:51.164829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:51.165248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:51.194274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-552db726-9419-4e76-914f-bcb6441a9a56 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Aug 24 15:53:51.194839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 526/1081] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:51.249782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:51.252758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:51.259225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:51.259740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:51.260177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:51.260874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:51.261328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:51.261750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:51.291513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d447780-bbad-4879-89ff-501190031ebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Aug 24 15:53:51.292149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 556/1082] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:51.656299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:51.659555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:51.666134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:51.666623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:51.667063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:51.667802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:51.668268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:51.668693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:51.700741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01fdc18e-ae10-4e59-b2f8-ceca1abc8481 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048344 Aug 24 15:53:51.702522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 527/1083] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:52.207990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:52.210146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:52.216573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:52.216828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:52.217265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:52.217962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:52.218419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:52.218846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:52.250556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-476d1b4b-7c52-4c48-96b9-8d660d2b7f2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048018 Aug 24 15:53:52.251314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 557/1084] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:52.304264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:52.306422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:52.312452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:52.312943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:52.313381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:52.314103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:52.315405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:52.315948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:52.347462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fdbe976e-3a74-4a50-b53f-3fbf7cd4bb35 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Aug 24 15:53:52.348081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 528/1085] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:52.713925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:52.716094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:52.722615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:52.723097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:52.723532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:52.724254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:52.724710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:52.725132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:52.755692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e2ecfa09-5905-495c-95de-f1302cd0c893 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045970 Aug 24 15:53:52.756255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 558/1086] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:53.263426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:53.265594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:53.272025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.272520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.272957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.273659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.274113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.274533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.305200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f7c34d6a-c419-4902-bc6b-b309dc39e617 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Aug 24 15:53:53.305884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 529/1087] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:53.359530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:53.362666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:53.368669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.369159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.369593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.370292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.370740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.371158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.385401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:53.401941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-afad4a08-6e15-4743-a605-3512a9e6221b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Aug 24 15:53:53.402607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 559/1088] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:53.769265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:53.773468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:53.779838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.780336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.780775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.781489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.781942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.782368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.818366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f84a1e3b-9fa5-45e6-8e41-1d9029936057 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053942 Aug 24 15:53:53.818956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 530/1089] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:53.891752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1833769808"}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:53:53.892302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:53.899305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.899837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.900308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:53.901025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:53.901516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:53.901942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.041141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.network.security_group_api [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Removing security group c309deec-462e-4b91-aaad-7c8d23bcfd51 from port 2d2bfb11-9546-4df1-9050-8f910b8ceba3 Aug 24 15:53:54.318232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:54.320548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:54.326933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.327500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.328029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.328804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.329326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.329851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.361731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-66b10b24-7955-4411-8a3e-44d845d545d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Aug 24 15:53:54.362321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 531/1090] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:54.372655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d4df2ba0-6a64-4c02-a256-2510cee6e0c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action" status: 202 len: 0 microversion: 2.1 time: 0.484911 Aug 24 15:53:54.374218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 560/1091] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:53:53 2022] POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:53:54.388669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-34db6450-d555-415c-834b-46225d90654f req-cd800f20-c210-458c-90a8-85dab8cf7901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:53:54.399618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-34db6450-d555-415c-834b-46225d90654f req-cd800f20-c210-458c-90a8-85dab8cf7901 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.400140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-34db6450-d555-415c-834b-46225d90654f req-cd800f20-c210-458c-90a8-85dab8cf7901 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.400976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-34db6450-d555-415c-834b-46225d90654f req-cd800f20-c210-458c-90a8-85dab8cf7901 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.415951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-34db6450-d555-415c-834b-46225d90654f req-cd800f20-c210-458c-90a8-85dab8cf7901 service nova] Creating event network-changed:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 15:53:54.418223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:54.422147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:54.423025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-34db6450-d555-415c-834b-46225d90654f req-cd800f20-c210-458c-90a8-85dab8cf7901 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037159 Aug 24 15:53:54.425645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 532/1092] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:54.430346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.431036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.432064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.432900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.433464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.433971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.467977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3b34dcf5-d160-470c-8d6c-ad4ada11e41e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055433 Aug 24 15:53:54.468644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 561/1093] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:54.831703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:54.833928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:54.840587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.841085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.841533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.842988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:54.843459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:54.843931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:54.876264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ad0b68b7-2f2b-4635-8c92-5c3b020608ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049026 Aug 24 15:53:54.876742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 533/1094] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:55.374010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:55.376325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:55.382856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.383427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.383991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.384849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.385308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.385729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.417552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e02e9b7e-bdd4-439e-a627-a50424edef5b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 24 15:53:55.418121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 562/1095] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:55.480191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:55.482419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:55.490044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.490552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.490997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.491737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.492222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.492658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.525523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1d2b7e72-41c3-4258-9881-4ed8f430fd86 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049267 Aug 24 15:53:55.526101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 534/1096] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:55.819943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:55.820470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:55.826695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.827435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.827580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-135b0544-20d5-4499-a303-81d35bdc755c req-a08dac93-148d-4503-9804-2aadda22ddab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:53:55.828262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.828972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.829419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.829847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.838598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-135b0544-20d5-4499-a303-81d35bdc755c req-a08dac93-148d-4503-9804-2aadda22ddab service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.839178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-135b0544-20d5-4499-a303-81d35bdc755c req-a08dac93-148d-4503-9804-2aadda22ddab service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.839719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-135b0544-20d5-4499-a303-81d35bdc755c req-a08dac93-148d-4503-9804-2aadda22ddab service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.856412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-135b0544-20d5-4499-a303-81d35bdc755c req-a08dac93-148d-4503-9804-2aadda22ddab service nova] Creating event network-changed:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 15:53:55.863129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-135b0544-20d5-4499-a303-81d35bdc755c req-a08dac93-148d-4503-9804-2aadda22ddab service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043101 Aug 24 15:53:55.864026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 535/1097] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:55.889337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:55.891949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:55.898427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.898669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.899103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.899830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:55.900449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:55.900870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:55.933997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lazy-loading 'services' on Instance uuid 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:53:55.936879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d94ae91b-fc0d-482f-a4a1-280392afb11f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051948 Aug 24 15:53:55.937764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 536/1098] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:53:56.019471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9cef62c6-37ba-46ab-8942-439f7dc90a6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments/d8101a05-ef94-4465-b161-dd34588e455d" status: 202 len: 0 microversion: 2.1 time: 0.203433 Aug 24 15:53:56.020357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 563/1099] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:53:55 2022] DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments/d8101a05-ef94-4465-b161-dd34588e455d => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:53:56.029542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:56.034300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:56.045312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.045896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.046463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.047344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.049328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.050165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.069192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:56.088767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d1afd93a-9003-4e4a-840d-fc1e8915de74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063497 Aug 24 15:53:56.089551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 537/1100] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:56.431588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:56.434651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:56.441148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.441634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.442065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.442768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.443212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.446445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.479316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-562f545d-7051-4aea-98d9-55ce2072addf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052504 Aug 24 15:53:56.479935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 564/1101] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:56.538393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:56.540591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:56.547300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.548070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.548552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.550418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.550889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.551323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.583191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-789eb0ba-e2cf-4e20-a40d-5da2c36ade42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048946 Aug 24 15:53:56.584026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 538/1102] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:56.949969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:56.952085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:56.958062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.958539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.958969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.959674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:56.960128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:56.960550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:56.991414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0a0f7086-f38b-4004-a953-d7a81c5d2ea8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045529 Aug 24 15:53:56.992005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 565/1103] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:57.102134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:57.104319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:57.110253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:57.110743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:57.111243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:57.112511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:57.112965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:57.113396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:57.144052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60750da2-6da3-440c-ab98-9119c89d7a2d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045472 Aug 24 15:53:57.145096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 539/1104] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:57.491863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:57.494046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:57.500038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:57.500520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:57.500955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:57.501687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:57.502100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:57.502522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:57.531420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa11eacc-d6e3-4aff-a888-039d047e4483 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Aug 24 15:53:57.532081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 566/1105] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:57.597156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:57.599309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:57.605365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:57.606046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:57.606495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:57.607197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:57.607667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:57.608094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:57.637389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d8ec7566-24e2-406c-b787-20dda8dc8ba0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Aug 24 15:53:57.637943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 540/1106] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:58.004606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:58.006665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:58.012708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.013204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.013630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.014330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.014782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.015203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.044351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ac931ed9-c0f3-496c-86be-0fea188b1f74 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044585 Aug 24 15:53:58.044900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 567/1107] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:58.159022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:58.161229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:58.167164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.167682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.168124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.168836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.169294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.169695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.199885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-243ba6f6-07e2-4afd-8f53-7fd3912ba58e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Aug 24 15:53:58.200445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 541/1108] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:58.544315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:58.546454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:58.553644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.554118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.554545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.555229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.555697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.556119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.584690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2393535d-c2eb-472d-918c-a4e4030a8e5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Aug 24 15:53:58.585241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 568/1109] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:58.649720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:58.651907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:58.661190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.661684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.662122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.662830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:58.663286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:58.663749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:58.693662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-367b449d-2514-4e52-be45-6bc89df6c875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048016 Aug 24 15:53:58.694231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 542/1110] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:59.057401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:59.059517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:59.065918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.066414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.066855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.067562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.068073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.068499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.104617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-58086a96-9731-43e2-9c8b-b891889f892d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050380 Aug 24 15:53:59.105265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 569/1111] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:53:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:53:59.213178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:59.215330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:59.221302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.221786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.222309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.223006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.223453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.223900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.253681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1dfc2685-d0da-4d90-9b53-eed7177fe23a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Aug 24 15:53:59.254236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 543/1112] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:59.597588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:59.599753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:59.606223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.606705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.607134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.607860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.608307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.608724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.639769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2835a716-37c2-48c2-b186-8a479b1c06fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046366 Aug 24 15:53:59.640323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 570/1113] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:53:59.706297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:53:59.708556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:53:59.715407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.715934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.716379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.717083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:53:59.717536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:53:59.717994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:53:59.749522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8e4f440f-a396-4b84-ac43-c9d7fa4b1d0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047897 Aug 24 15:53:59.750088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 544/1114] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:53:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:00.120679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:00.123347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:00.130955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.131453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.131920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.132653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.133114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.133552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.170080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eee4cd1f-4c74-4056-be00-9baf31f34535 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055759 Aug 24 15:54:00.170664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 571/1115] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:00.268147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:00.270341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:00.281128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.281611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.282053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.282755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.284067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.284510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.314078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-19a6aad8-7411-48dd-a870-e18057cc2253 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051853 Aug 24 15:54:00.314953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 545/1116] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:00.652385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:00.654557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:00.661738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.662221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.662663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.663367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.663846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.664269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.695066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-28725491-1ada-44c2-8be5-2ee52c319839 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 Aug 24 15:54:00.695661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 572/1117] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:00.762728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:00.764949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:00.772176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.772667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.773110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.773822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:00.774273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:00.774695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:00.806676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6773d87b-d071-4f02-9c33-99be76f5952c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047899 Aug 24 15:54:00.807269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 546/1118] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:01.183069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:01.185249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:01.191925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.192418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.192888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.193594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.194055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.194485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.226430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-03ec2cac-c873-4c90-9360-831371d40643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047378 Aug 24 15:54:01.227014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 573/1119] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:01.326870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:01.329133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:01.335778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.336266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.336956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.337652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.338107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.338534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.367511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9d2abf21-c1e9-459c-bdc3-6bb9b7f15623 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Aug 24 15:54:01.368097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 547/1120] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:01.707408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:01.709579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:01.716344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.716833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.717275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.717972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.718432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.718861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.748548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c2e514d4-cfd3-4eb2-9bed-a21a4527340d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Aug 24 15:54:01.749103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 574/1121] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:01.819066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:01.821371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:01.828060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.828539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.828969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.829663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:01.830109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:01.830534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:01.862886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a4392520-16da-40a4-aa23-2120b337181d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048387 Aug 24 15:54:01.863433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 548/1122] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:02.239648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:02.241841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:02.247937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.248423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.248851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.249557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.250046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.250425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.274845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:02.280121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-25543187-214e-44b8-a872-a914df1293db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045194 Aug 24 15:54:02.280707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 575/1123] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:02.380252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:02.382518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:02.388703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.389189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.389633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.390329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.390786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.391216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.419909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3019d627-59cf-4621-a7ca-7a5af5639afa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Aug 24 15:54:02.420464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 549/1124] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:02.762038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:02.764185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:02.771355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.771870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.772304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.772989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.773438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.773870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.803344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b5514a4-ea29-43d0-ac3c-0de2f0079bdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Aug 24 15:54:02.803942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 576/1125] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:02.874654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:02.876856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:02.883795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.884294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.884739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.885471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:02.885931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:02.886415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:02.919962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e4ef9733-8ca8-4453-903c-d4babb6f4695 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049012 Aug 24 15:54:02.920422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 550/1126] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:03.293684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:03.295767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:03.302349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.302841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.303283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.304034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.304493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.304923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.334671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b31c09d-85fc-49c8-9481-ca0f3bef085a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045200 Aug 24 15:54:03.335237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 577/1127] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:03.432804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:03.434956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:03.441689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.442175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.442614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.443310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.443804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.444233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.473414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a174ab7f-a726-4598-9553-a4dea865635c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Aug 24 15:54:03.473992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 551/1128] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:03.816949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:03.819143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:03.825827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.826316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.826755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.827463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.827950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.828413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.860047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ccaea3f1-e2a2-4faa-bb00-c52812a07fc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Aug 24 15:54:03.860607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 578/1129] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:03.933158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:03.934965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:03.941738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.942224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.943014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.943373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:03.943870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:03.944299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:03.973740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb96d418-9a86-4c5e-88e6-07a6260980e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Aug 24 15:54:03.974293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 552/1130] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:04.347336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:04.349461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:04.355405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.355931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.356369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.357060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.357514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.357938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.386791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-090cff63-0f94-4070-b45f-ed4f2501e5b6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Aug 24 15:54:04.387347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 579/1131] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:04.487531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:04.489876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:04.496418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.496901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.497340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.498050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.498508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.498935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.530427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d9252690-daad-45cb-a989-cb83eb7aa650 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048380 Aug 24 15:54:04.531009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 553/1132] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:04.873107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:04.875177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:04.882707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.883201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.883656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.884372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.884830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.885257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.915151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-38ada32c-946e-468c-86bd-a397a5516a16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Aug 24 15:54:04.915722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 580/1133] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:04.985632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:04.988472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:04.994794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.995274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.995735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.996428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:04.996876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:04.997300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:04.999613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:05.027585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-af6191c9-ca22-49af-b4e4-866cb2206559 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045860 Aug 24 15:54:05.028163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 554/1134] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:05.399251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:05.401486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:05.407914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:05.408908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:05.409614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:05.410360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:05.410825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:05.411261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:05.451579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-46530bf0-51a3-443b-9a46-6ab668caf472 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056247 Aug 24 15:54:05.452175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 581/1135] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:05.542863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:05.545060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:05.551089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:05.551589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:05.552064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:05.552759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:05.553215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:05.553642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:05.582283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e69cff23-6279-4559-b6cf-b7d909111d69 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Aug 24 15:54:05.582831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 555/1136] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:05.927350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:05.929620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:05.936227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:05.936693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:05.937122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:05.937813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:05.938259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:05.938678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:05.969369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-61d26163-dc60-4d46-9a37-0155626aa468 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046014 Aug 24 15:54:05.969929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 582/1137] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:06.039888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:06.042041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:06.048575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.049155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.049735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.050465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.050932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.051361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.080898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1a2176a4-8b9e-4224-a8a6-aa0621635516 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Aug 24 15:54:06.081359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 556/1138] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:06.465226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:06.467434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:06.474656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.475150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.475587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.476320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.476775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.477205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.509594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b6968e1d-e014-4bec-9425-b646c833492a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048816 Aug 24 15:54:06.510167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 583/1139] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:06.594894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:06.597278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:06.603187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.603693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.604131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.604818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.605268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.605681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.634848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-757beb7f-3bde-4e82-a94f-f3d609f678f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Aug 24 15:54:06.635486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 557/1140] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:06.986141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:06.989162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:06.995868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.997105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.997557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:06.998296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:06.998754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:06.999299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.029943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e6d5a12e-0255-4e7b-85ad-84812a29277b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052377 Aug 24 15:54:07.030500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 584/1141] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:07.093254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:07.095388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:07.102620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:07.103047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:07.103485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.104220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:07.104672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:07.105098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.135207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c5736f3c-4a85-4157-b5f8-a18e4374b461 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Aug 24 15:54:07.135791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 558/1142] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:07.522938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:07.525154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:07.532020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:07.532513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:07.532954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.534237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:07.534702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:07.535145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.570139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa4a5710-42fe-46e1-aa59-dfa7d06a7232 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052482 Aug 24 15:54:07.570704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 585/1143] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:54:07.646813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:07.649010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:07.655048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:07.655531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:07.656007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.656708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:07.657165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:07.657621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:07.685938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-032efe89-5b0a-408f-887c-f9b8a327abfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Aug 24 15:54:07.686488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 559/1144] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:08.042364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:08.044727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:08.051788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.052276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.052716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.053412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.053867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.054295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.083158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3ab0620f-2d54-4bb6-99d4-58b93d0d7b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Aug 24 15:54:08.083718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 586/1145] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:08.148405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:08.151436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:08.154107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:08.161894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.162592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.163270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.164246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.164901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.165485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.196775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d49a8d68-a49b-4a2b-9be9-c1a5b39f31a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053239 Aug 24 15:54:08.197343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 560/1146] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:08.583417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:08.585619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:08.587927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:08.593526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.594016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.594461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.595172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.595643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.596081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.627523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-275b57ee-c1f6-4028-bde7-ce0d54dcf772 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048645 Aug 24 15:54:08.628125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 587/1147] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:08.698317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:08.700546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:08.706945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.707420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.707873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.708559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:08.709008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:08.709423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:08.740357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-22ca93d3-b3a2-4686-b224-7e79558d3d25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Aug 24 15:54:08.740939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 561/1148] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:09.095857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:09.098834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:09.105274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.105775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.106211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.106935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.107387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.107858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.138114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86ca68c6-dd08-47bf-9206-a152af48dccf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Aug 24 15:54:09.138700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 588/1149] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:09.209735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:09.212267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:09.224526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.225075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.225465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.226232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.226691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.227119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.260220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb07bc58-faa7-457a-92f5-b259714127e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054968 Aug 24 15:54:09.260786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 562/1150] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:09.640222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:09.643126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:09.650644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.651139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.651571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.652299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.652753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.653177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.684113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc017454-0741-4b79-a3aa-06132f5b1867 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047832 Aug 24 15:54:09.684668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 589/1151] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:09.752710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:09.755002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:09.760949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.761435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.761870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.762566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:09.763022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:09.763455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:09.792321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3e4f8e20-3c36-4fc8-bc31-e8ba2f920066 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Aug 24 15:54:09.792877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 563/1152] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:10.150346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:10.152542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:10.158899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.160079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.160631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.161325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.161779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.162200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.190827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-79a4ebbc-a328-467e-aa27-1dbfadd80ad8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Aug 24 15:54:10.191553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 590/1153] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:10.273247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:10.275348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:10.281939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.282426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.282857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.283559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.284034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.285088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.316419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-721e3760-c5b3-4505-a7a6-cc87863f3f88 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Aug 24 15:54:10.316954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 564/1154] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:10.696763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:10.698889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:10.704796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.705276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.705706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.706392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.706838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.707260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.736506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c588f1e-3da5-4cf8-9c72-283b1888cb4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Aug 24 15:54:10.737049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 591/1155] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:10.805256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:10.807408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:10.813414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.813903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.814345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.815042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:10.815495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:10.816162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:10.845826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e8b3cdb-279f-4557-9de6-89d34da970bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Aug 24 15:54:10.846400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 565/1156] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:11.202480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:11.204657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:11.211125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.211612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.212336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.213036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.213493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.213923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.227951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:11.246000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cb8cbf97-28e6-4aa3-aa19-5e012b33172a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Aug 24 15:54:11.246557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 592/1157] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:11.328931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:11.331024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:11.338729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.339219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.339690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.340398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.340854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.341288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.372600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-65c3d147-dd9a-414a-986c-9b7389838acb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047661 Aug 24 15:54:11.373144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 566/1158] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:11.750060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:11.752405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:11.758906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.759393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.759864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.760568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.761027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.761456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.792394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fea2c219-aba0-49a4-842e-197822922fa9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046485 Aug 24 15:54:11.792979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 593/1159] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:11.858738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:11.860961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:11.867122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.867603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.868143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.868838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:11.869288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:11.869709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:11.898487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bdd22e42-2bdf-4d53-aace-3407f05045fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Aug 24 15:54:11.899038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 567/1160] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:12.258599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:12.260827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:12.267182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.267700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.268147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.269251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.269453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.269890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.298612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c33eda07-9cfe-4540-a3c6-0b103ab115ba tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Aug 24 15:54:12.299189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 594/1161] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:12.386048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:12.388223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:12.395418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.395883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.396325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.397033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.397492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.397922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.429029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e7a262fc-a60d-4e39-97c7-13bc080bab81 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 24 15:54:12.429599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 568/1162] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:12.805754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:12.807858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:12.813915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.814401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.814838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.815533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.816286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.816799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.846552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2426d99f-24bc-40fb-8a53-b6b7f6e18105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045544 Aug 24 15:54:12.847702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 595/1163] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:12.911397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:12.913644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:12.919622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.920124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.920557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.921251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:12.921699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:12.922122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:12.959206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ff07e80-7ed8-451c-bc62-e81e02d0cf29 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052480 Aug 24 15:54:12.959779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 569/1164] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:13.311538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:13.313728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:13.320820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.321235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.321673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.322368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.322823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.323248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.358422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c83550ed-f1d8-449e-bc9d-98cf9883369c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050757 Aug 24 15:54:13.358995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 596/1165] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:13.441845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:13.444043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:13.450367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.450846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.451278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.452002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.452452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.452869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.478091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:13.483168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a9cbae34-9529-4501-a4dd-36db299a5fd4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 Aug 24 15:54:13.483904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 570/1166] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:13.859240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:13.861474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:13.868234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.868718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.869152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.869849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.870304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.870730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.900162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f280a98-5591-4b03-99ec-dc9696093c15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044764 Aug 24 15:54:13.900642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 597/1167] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:13.972099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:13.974297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:13.981492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.982364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.983180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:13.984011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:13.984846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:13.985680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.019809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-54eff3f7-c5fd-4e1b-9df3-779d585e52bc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051648 Aug 24 15:54:14.020371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 571/1168] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:14.370424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:14.372601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:14.379578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:14.380103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:14.380539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.381234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:14.381694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:14.382119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.411616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54787ce5-ef2a-47d6-bca1-a798c255cbd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Aug 24 15:54:14.412209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 598/1169] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:14.495677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:14.497890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:14.504914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:14.505406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:14.505916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.506544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:14.507006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:14.507432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.539470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-76f98c89-c233-4359-af82-70568218ddfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Aug 24 15:54:14.540066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 572/1170] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:14.913013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:14.915176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:14.921240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:14.921718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:14.922152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.922837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:14.923286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:14.923768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:14.954707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-04ff8c53-6419-4de5-b659-5c06cf5bd820 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046024 Aug 24 15:54:14.955265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 599/1171] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:15.031683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:15.033831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:15.040092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.040581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.041015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.041713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.042168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.042594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.072741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e30e1faa-4c26-4154-b5df-8fa7c23407a3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 24 15:54:15.073307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 573/1172] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:15.423822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:15.426776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:15.433530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.434015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.434451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.435154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.435609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.436057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.465410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86689766-6a54-4358-939a-81832df98f09 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Aug 24 15:54:15.465963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 600/1173] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:15.553018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:15.555202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:15.561734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.562120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.562557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.563254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.563749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.564178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.594169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e47a8da8-ca36-4b93-9429-4c8689469bdd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046292 Aug 24 15:54:15.594728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 574/1174] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:15.967770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:15.969926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:15.976584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.977080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.977516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:15.978245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:15.978701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:15.979129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.008957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-75d3d916-8341-41ce-92fa-c36808917595 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045218 Aug 24 15:54:16.009526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 601/1175] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:54:16.084982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:16.087181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:16.093546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:16.094030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:16.094468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.095165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:16.095623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:16.096083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.127382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-161100b9-f49a-48bf-a4f5-91251a67a576 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Aug 24 15:54:16.128010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 575/1176] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:16.478504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:16.480778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:16.487205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:16.487729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:16.488166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.489543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:16.490042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:16.490467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.520775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a80dd736-5ada-49dc-8d29-f2519f10a596 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046346 Aug 24 15:54:16.521334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 602/1177] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:16.606390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:16.608564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:16.615477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:16.615988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:16.616414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.617104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:16.617549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:16.617970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:16.647384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bdbb7942-db25-4559-8c1a-6a85d0e8c41a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Aug 24 15:54:16.647891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 576/1178] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:17.022075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:17.024283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:17.030303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.030785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.031217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.031944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.032402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.032837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.062931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4dd0b7f-d5c0-4cba-b8b8-ab4bb69820b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Aug 24 15:54:17.063491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 603/1179] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:17.139224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:17.141389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:17.148522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.149004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.149449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.150146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.150600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.151029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.181658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01e0dcca-fc99-44f7-9279-6c9a88ef8f56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Aug 24 15:54:17.182219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 577/1180] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:17.533480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:17.536325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:17.543048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.547278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.547763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.548810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.549021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.549447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.581649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d25c72fc-638a-479b-a84f-9c6b8650d1d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052071 Aug 24 15:54:17.582217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 604/1181] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:17.659581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:17.662452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:17.669097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.669520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.669957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.670650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:17.671104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:17.671524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:17.701154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a7632bf2-e12e-4f8c-a124-9aad16c9cb47 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Aug 24 15:54:17.701707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 578/1182] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:18.075376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:18.077518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:18.083463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.083975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.084407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.085092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.085542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.085964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.115132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7ceac0c5-63b5-41aa-ac18-2a35205591e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043799 Aug 24 15:54:18.115703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 605/1183] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:18.194262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:18.196463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:18.202411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.202889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.203320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.204048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.204496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.204918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.233525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4d053a35-562d-49b8-9750-966e1720f7b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Aug 24 15:54:18.234101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 579/1184] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:18.594116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:18.596306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:18.606346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.606838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.607274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.608019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.608488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.608914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.641549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-578e7e12-38e2-47c7-a2ce-baa8c3eb4549 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051468 Aug 24 15:54:18.642122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 606/1185] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:18.714551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:18.717090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:18.729400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.729898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.730338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.731142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:18.731760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:18.732446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:18.768207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-04bab786-d15c-4741-9658-f3e6086d1226 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057928 Aug 24 15:54:18.768794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 580/1186] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:19.127307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:19.129543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:19.135601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.136121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.136550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.137237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.137687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.138103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.174444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-639fbb53-d444-40b9-83d8-7a57d34adf21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051338 Aug 24 15:54:19.175261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 607/1187] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:54:19.246764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:19.248936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:19.254773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.255252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.255710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.256402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.256875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.257291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.285844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b3904d2b-21d8-4512-94eb-44f67df7c02e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Aug 24 15:54:19.286396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 581/1188] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:19.654771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:19.656971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:19.663414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.663950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.664389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.665091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.665554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.665981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.696030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9cd2a38c-d467-4849-b4a7-b7c6a4972cf4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Aug 24 15:54:19.696593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 608/1189] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:19.781391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:19.783496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:19.790989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.791475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.791951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.792654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:19.793140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:19.793608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:19.824205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3b201758-ef8a-49cf-aebc-39b82b4bdb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Aug 24 15:54:19.824771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 582/1190] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:20.187573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:20.189811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:20.196139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.196619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.197051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.197808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.198264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.198691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.201124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:20.231089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-499dc004-0aea-4ac3-97d1-c52708068c9c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047451 Aug 24 15:54:20.231667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 609/1191] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:20.297724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:20.299927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:20.306227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.306710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.307145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.307871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.308327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.308752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.338693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6d2e5655-5bc9-40d1-bda6-c853f8a1f4e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Aug 24 15:54:20.339260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 583/1192] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:20.708507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:20.710710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:20.717402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.717885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.718331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.719035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.719487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.719944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.750096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71da78f2-ca00-4d05-a86d-7cd72dfa6c17 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Aug 24 15:54:20.750657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 610/1193] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:20.837247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:20.839588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:20.845653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.846145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.846586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.848285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:20.848285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:20.849463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:20.880326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-430e9594-ab29-471f-aa24-b09052851703 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047235 Aug 24 15:54:20.880929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 584/1194] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:21.244028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:21.246215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:21.252159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.252645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.253079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.253774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.254911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.255355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.284079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2f1d58e4-9721-4e44-8227-e191012cd0ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044048 Aug 24 15:54:21.284630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 611/1195] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:21.351450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:21.353641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:21.360050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.360535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.360992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.361664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.362114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.362604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.391278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d30f8682-76bc-48cc-bd6c-bf4dd37ec20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Aug 24 15:54:21.391858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 585/1196] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:21.762933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:21.765114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:21.772637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.773127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.773568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.774267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.774723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.775149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.805534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0d48768-cb87-41e9-8e80-ae63cc3e2d7e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Aug 24 15:54:21.806102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 612/1197] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:21.894120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:21.897303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:21.903589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.904110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.904549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.905278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:21.905713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:21.906143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:21.949784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7b4a385e-f057-456c-9cce-94bdb1790fdc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059645 Aug 24 15:54:21.950340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 586/1198] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:22.297200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:22.299376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:22.306480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.306958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.307417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.308136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.308591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.309009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.338000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7aa362e8-100a-4f28-88c3-85310bda0073 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044548 Aug 24 15:54:22.338563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 613/1199] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:22.403569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:22.405746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:22.413052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.413528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.413963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.414660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.415111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.415538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.429671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:22.445534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4850499e-709e-47c3-bfbe-e7ce0b7c4925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 24 15:54:22.446085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 587/1200] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:22.817843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:22.820068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:22.826546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.827024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.827504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.828227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.828677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.829095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.859708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d27cdaf6-f9e2-4fa1-9968-2001d1612c5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Aug 24 15:54:22.860271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 614/1201] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:22.963297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:22.966879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:22.974830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.975324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.975794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:22.976505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:22.976990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:22.977420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.016090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-27a3c6fb-198e-4c3f-9c9c-92866d8ec36d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057789 Aug 24 15:54:23.016655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 588/1202] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:23.352094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:23.354138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:23.360116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:23.360592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:23.361018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.361702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:23.362151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:23.362567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.390953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee70de56-e86c-429a-aff4-46adb3a3794d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043627 Aug 24 15:54:23.391504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 615/1203] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:23.458664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:23.464908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:23.471273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:23.471789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:23.472231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.473567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:23.474020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:23.474628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.503094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3e8fe236-0945-44ad-8e4a-284b380f7443 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 Aug 24 15:54:23.503658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 589/1204] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:23.873053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:23.875244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:23.882521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:23.883010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:23.883450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.884188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:23.884651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:23.885085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:23.917512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b5fd4d0d-5ca1-4064-9ecd-60493b33ce25 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048425 Aug 24 15:54:23.918254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 616/1205] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:24.029245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:24.031282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:24.037430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.037916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.038356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.039060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.039515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.039978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.069910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a5c9c1db-2aab-4ea8-9215-4d89e3f01169 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Aug 24 15:54:24.070477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 590/1206] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:24.403368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:24.405577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:24.412942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.413436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.413870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.414566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.415014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.415432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.444734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e9acbe4c-c595-4086-8357-4177e5292161 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045326 Aug 24 15:54:24.445286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 617/1207] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:24.516058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:24.518183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:24.524745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.525228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.525670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.526363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.526847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.527271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.556535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-638eca74-bb28-483f-8305-463cde41cf61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Aug 24 15:54:24.557093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 591/1208] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:24.930468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:24.935435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:24.939917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.940400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.940832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.941536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:24.941984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:24.942404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:24.973027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9325f74c-ffcf-4371-a50c-2b57808fad3b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047336 Aug 24 15:54:24.973578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 618/1209] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:25.082310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:25.085647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:25.091897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.092386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.092855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.093558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.094015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.094445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.124054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aeaef9e2-39d7-4aef-9c46-1087cd9aa8d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045632 Aug 24 15:54:25.124621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 592/1210] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:25.456689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:25.459377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:25.465638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.466117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.466546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.467231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.467702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.468121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.502426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-72770467-9117-4374-8f4c-eaa8f052d43d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049767 Aug 24 15:54:25.502973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 619/1211] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:25.569122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:25.572167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:25.578526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.579009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.579443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.580178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.580629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.581053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.610635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b83fe83e-ad41-4e13-84b1-c99491994476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Aug 24 15:54:25.611239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 593/1212] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:25.986189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:25.988366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:25.995938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.996428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.996867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:25.997566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:25.998024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:25.998454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.028256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-debe809e-2517-4fa5-8acb-64d5b4a89aaf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Aug 24 15:54:26.028815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 620/1213] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:26.136735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:26.138873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:26.144844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:26.145326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:26.145763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.147111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:26.147566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:26.148019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.178856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5fdbee93-dc75-4a38-b9d8-abbcbc4d2986 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046003 Aug 24 15:54:26.179413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 594/1214] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:26.515326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:26.517511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:26.524710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:26.525196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:26.525640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.526333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:26.526784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:26.527210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.556231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a063ec0d-37d2-4862-acbe-222e9388e586 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044944 Aug 24 15:54:26.556790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 621/1215] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:26.624526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:26.626660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:26.633622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:26.634106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:26.634573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.635274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:26.635758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:26.636184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:26.665792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb3bd7c8-62f4-46c7-ada4-4c8da17ce2da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Aug 24 15:54:26.666348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 595/1216] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:27.041086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:27.043298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:27.049720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.050209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.050670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.051348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.051839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.052781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.100342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22ff314f-e60a-43cb-b5fc-2e64afcb71af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063650 Aug 24 15:54:27.100833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 622/1217] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:27.190833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:27.194283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:27.200316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.200804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.201248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.201983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.202480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.202882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.238040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ca171f40-912b-45a5-a02c-689530d8158a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051195 Aug 24 15:54:27.238604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 596/1218] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:27.568817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:27.571022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:27.577063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.577538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.577970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.578656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.579101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.579525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.614775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-55053752-485b-45ac-a220-f20cae2c1226 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049870 Aug 24 15:54:27.615337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 623/1219] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:27.679124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:27.681392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:27.687881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.688371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.688810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.689509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:27.689972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:27.690389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:27.720845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bcb50d14-2e15-42d3-8baa-833a1cde2eb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046212 Aug 24 15:54:27.721406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 597/1220] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:28.112231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:28.114328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:28.120351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.120838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.121372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.122259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.122749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.123213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.153188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8deb263b-00ab-4b15-a6b0-e7197ed92123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Aug 24 15:54:28.153752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 624/1221] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:28.251519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:28.253686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:28.261379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.261892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.262377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.263092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.263551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.264009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.295856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5521a2ce-4137-4716-8d03-84190232661a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048212 Aug 24 15:54:28.296415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 598/1222] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:28.627415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:28.629572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:28.637791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.638277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.638710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.639411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.639895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.640315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.663915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:28.670615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1117c3af-4b2e-4d57-87b5-b28896a67c4c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047208 Aug 24 15:54:28.671171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 625/1223] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:28.734531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:28.736806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:28.744128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.744614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.745080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.745782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:28.746233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:28.746656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:28.775228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-29b300b4-d20a-422b-9be3-c44fceb816e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Aug 24 15:54:28.775808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 599/1224] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:29.166757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:29.168977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:29.174965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.175444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.175914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.176607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.177054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.177472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.206076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fdbd1bde-4e7f-44ad-9da1-f683e819528e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Aug 24 15:54:29.206630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 626/1225] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:29.308105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:29.310269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:29.316163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.316650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.317081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.317773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.318225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.318651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f42c634c-a36a-448a-8bd7-fe1a280eda49 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Aug 24 15:54:29.348591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 600/1226] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:29.683504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:29.685700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:29.692105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.692585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.693019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.693710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.694164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.694577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.725180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7787dbc-e352-450d-a295-c09687cd2760 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045984 Aug 24 15:54:29.725752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 627/1227] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:29.787570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:29.789936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:29.796328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.796813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.797245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.797939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:29.798391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:29.798816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:29.828476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-955172db-57d9-4277-94c9-e7bf99ae50bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 24 15:54:29.829046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 601/1228] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:30.219030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:30.221381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:30.227905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.228384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.228819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.229501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.229949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.230395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.260339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-934aa287-c544-41bc-92e8-36d8da7a917b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045452 Aug 24 15:54:30.260916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 628/1229] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:30.360912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:30.362982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:30.370123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.370610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.371055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.371793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.372254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.372676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.401668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-584771a5-35a9-4d0b-b4ba-4cd5738f7ab4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 24 15:54:30.402214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 602/1230] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:30.737009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:30.739160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:30.745841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.746364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.746825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.747529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.748022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.748450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.778431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-382ab0f4-eed2-49a0-98f8-017d50081af1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045435 Aug 24 15:54:30.778998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 629/1231] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:54:30.840901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:30.843066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:30.849758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.850248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.850686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.852101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:30.852597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:30.853048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:30.881734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6701baf-6f7a-4e3d-b596-3407f539c02b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Aug 24 15:54:30.882300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 603/1232] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:31.272984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:31.276362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:31.282297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.282786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.283226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.283954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.284413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.284842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.314629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-047efa84-5619-4db9-8f22-0db2157de54c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Aug 24 15:54:31.315227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 630/1233] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:31.418689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:31.421001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:31.428345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.428860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.429303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.430686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.431158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.431586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.434057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:31.463104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-48100d08-ffbb-4aeb-9072-a10acd62cae2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048554 Aug 24 15:54:31.463931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 604/1234] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:31.791497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:31.793607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:31.800052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.800535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.800970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.801658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.802116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.802537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.832053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc09ca26-fe78-490f-9c79-9f842d6104f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045107 Aug 24 15:54:31.832620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 631/1235] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:31.894373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:31.896542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:31.903075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.903559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.904028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.904721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:31.905174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:31.905595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:31.935538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5deaddec-76e7-4316-8ed6-ebd4752f940c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 24 15:54:31.936226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 605/1236] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:32.326793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:32.329006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:32.334984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.335464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.336555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.337176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.337630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.338055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.368172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b3d62d35-4891-4ce7-9ac1-1217ce0f2474 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Aug 24 15:54:32.368728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 632/1237] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:32.475913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:32.478572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:32.484534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.485015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.485702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.486157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.486619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.487046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.517899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-95f09065-30ac-410d-95be-8046aaa1af9f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045991 Aug 24 15:54:32.518456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 606/1238] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:32.844786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:32.846956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:32.853716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.854193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.854623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.855321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.855823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.856242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.888147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1e97e886-e3e4-4e9a-97d6-7abcdcb446a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047395 Aug 24 15:54:32.888723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 633/1239] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:32.947954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:32.950148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:32.956921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.957405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.957842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.958553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:32.959008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:32.959432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:32.988892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8690ff5b-f317-40e9-b66b-2e7d3a067981 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Aug 24 15:54:32.989454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 607/1240] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:33.380729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:33.382877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:33.389587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:33.390070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:33.390506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:33.391283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:33.391770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:33.392198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:33.421673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-472310f8-205e-4e20-9caf-7dd31894ef4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Aug 24 15:54:33.422227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 634/1241] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:33.533055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:33.535122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:33.542537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:33.543088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:33.543530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:33.544275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:33.544733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:33.545157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:33.575353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-518ddf7e-7ca4-415b-b63c-3bc2a67c3a60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047622 Aug 24 15:54:33.575945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 608/1242] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:33.900626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:33.902795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:33.909276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:33.909757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:33.910191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:33.910880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:33.911329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:33.911788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:33.942457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6ad7689-4749-41a7-8e69-f32df4e32bf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045830 Aug 24 15:54:33.943019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 635/1243] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:34.002222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:34.004409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:34.010940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.011424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.011893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.012594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.013048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.013475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.042461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c610752d-f436-4265-9a69-498bc64921d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 24 15:54:34.043026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 609/1244] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:34.434415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:34.436581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:34.442748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.443227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.443678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.444367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.444812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.445230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.475878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf4cbc84-a4ac-485d-afd2-3d90cb49a2cf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 24 15:54:34.476447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 636/1245] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:34.588847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:34.590911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:34.592879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:34.597968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.598444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.598872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.599558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.600039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.600458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.629871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0298746a-bb8e-411b-8434-bb63c9d6bf22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Aug 24 15:54:34.630431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 610/1246] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:34.954543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:34.956788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:34.959169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:34.965811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.966293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.966727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.967426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:34.967996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:34.968423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:34.997560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-12cf4301-19ca-498c-a88b-be0f1f0d3ed9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047006 Aug 24 15:54:34.998122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 637/1247] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:35.054640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:35.057311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:35.063616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:35.064126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:35.064565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:35.065276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:35.065711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:35.066135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:35.095674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-85cc552a-2964-4906-8c8e-9ba1579235b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 15:54:35.096223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 611/1248] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:35.489133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:35.491287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:35.498127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:35.498611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:35.499388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:35.500176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:35.500637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:35.501060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:35.531098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-be87efad-3c1c-4215-8689-c3aafd358f9a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Aug 24 15:54:35.531678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 638/1249] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:35.641138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:35.643348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:35.649478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:35.649963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:35.650402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:35.651099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:35.651610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:35.652060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:35.682870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-43be3f9c-8dac-47e2-b9b5-07557470a607 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Aug 24 15:54:35.683421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 612/1250] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:36.010135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:36.012318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:36.018684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.019160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.019594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.020299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.020751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.021168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.051970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7782642f-1fc4-46e7-8d53-de9b1acbc05b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045894 Aug 24 15:54:36.052524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 639/1251] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:36.108398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:36.110553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:36.116887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.117364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.117798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.118762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.119217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.119664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.147675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6253e74f-2467-4323-be9d-72b28aa8153f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Aug 24 15:54:36.148254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 613/1252] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:36.544189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:36.546353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:36.552506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.552967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.553404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.554110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.554566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.554992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.584474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ac818c02-037c-45e5-8fee-3bde4a92eb3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 24 15:54:36.585025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 640/1253] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:36.694550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:36.696902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:36.704621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.705103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.705542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.706234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:36.706688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:36.707108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:36.737847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c90fb8f9-7bf3-42d0-a0f3-4ddf55fcbb71 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047273 Aug 24 15:54:36.738412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 614/1254] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:37.064420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:37.066540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:37.073680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.074160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.074591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.075278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.075753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.076175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.105837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4e4da775-2af8-417c-9e9a-3359ae3eca20 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045366 Aug 24 15:54:37.106317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 641/1255] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:37.160448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:37.162584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:37.169023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.169504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.169941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.170637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.171087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.171510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.199968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8db10d4c-56b6-415b-9737-d917102dee08 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 Aug 24 15:54:37.200520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 615/1256] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:37.605161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:37.607320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:37.613390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.613904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.614350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.615058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.615516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.615975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.631068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:37.648576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0bf45103-585a-4374-b3cd-caae662135c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Aug 24 15:54:37.649205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 642/1257] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:37.750718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:37.752880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:37.759580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.760086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.760536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.761236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:37.761695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:37.762128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:37.793127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4b547f67-785a-480a-b865-8e37b9a697a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Aug 24 15:54:37.793698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 616/1258] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:38.119392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:38.121755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:38.130266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.130755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.131196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.131931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.132391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.133718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.166936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7cb3badd-1bc7-4110-8846-60aacd876966 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052510 Aug 24 15:54:38.167496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 643/1259] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:54:38.212765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:38.215248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:38.221619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.222105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.222542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.223243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.223723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.224147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.255088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ef6d2a3b-958d-47f8-9821-02571b49be8a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046764 Aug 24 15:54:38.255671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 617/1260] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:38.661064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:38.663267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:38.669967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.670461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.670899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.671598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.672083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.672514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.702929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d929d7e-e4c5-4355-9d18-df320c234b07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045854 Aug 24 15:54:38.703495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 644/1261] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:38.805412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:38.808519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:38.814509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.814993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.815431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.816160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:38.816616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:38.817044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:38.848829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-95b59f11-b89b-4c5b-8a53-76c8cf6250c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 24 15:54:38.849570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 618/1262] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:39.179265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:39.182673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:39.189122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.189610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.190053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.190749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.191210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.191655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.221796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3bf390d1-09ae-42be-bb5e-e8c30626083e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046504 Aug 24 15:54:39.222351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 645/1263] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:39.266707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:39.268963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:39.275464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.275973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.276413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.277111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.277570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.277999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.306872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7d2f2949-1e62-4c91-99d9-efb19fc49f46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 24 15:54:39.307430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 619/1264] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:39.716500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:39.718670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:39.724859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.725342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.725777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.726490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.726950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.727508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.758775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f39916e4-2bec-4baa-8040-9f099dcf740c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047422 Aug 24 15:54:39.759576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 646/1265] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:39.861821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:39.864015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:39.870199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.870688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.871122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.871855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:39.872309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:39.872734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:39.897619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:39.903680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-627b68a7-1ac0-4e3e-bffa-be01dd8de119 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Aug 24 15:54:39.904241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 620/1266] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:40.234190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:40.236375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:40.242783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.243451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.243965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.244661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.245105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.245525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.277027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ba29ac6a-7bdd-43bb-9875-84e2ab84a818 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046764 Aug 24 15:54:40.277599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 647/1267] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:40.318925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:40.321185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:40.328741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.329229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.329671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.330375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.330831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.331259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.361019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-64e29def-62a2-49ea-a505-f12faeb84b12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046014 Aug 24 15:54:40.361582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 621/1268] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:40.771121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:40.773283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:40.779209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.779716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.780154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.780840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.781290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.781711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.811073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-45c6ba27-3529-42e1-bea8-3610a7fe6deb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Aug 24 15:54:40.811645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 648/1269] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:40.916739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:40.918891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:40.924992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.925477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.925913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.926609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:40.927062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:40.927488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:40.963523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-448b0f90-54ba-46b2-abae-3d2f599382ef tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051360 Aug 24 15:54:40.964361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 622/1270] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:41.289304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:41.292436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:41.298995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.299482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.299957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.300659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.301115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.301543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.330046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f4dbb3e4-c693-4ba5-bf4a-9943570fb5b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044714 Aug 24 15:54:41.330602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 649/1271] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:41.372740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:41.374952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:41.381426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.381900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.382332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.383044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.383490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.384026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.412767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-08124407-fd2e-4711-a905-cccab73eb3dd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 24 15:54:41.413313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 623/1272] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:41.823907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:41.826077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:41.832104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.832583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.833012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.833701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.834149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.834568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.864998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ea8ff486-0ad0-4528-ba6c-17c4162e861c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Aug 24 15:54:41.865552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 650/1273] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:41.976177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:41.978416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:41.984554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.985041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.985484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:41.986241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:41.986698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:41.987128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.019166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01cce003-1370-4f65-9285-767336cd2e3c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Aug 24 15:54:42.019770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 624/1274] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:42.343080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:42.345153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:42.351435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:42.351951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:42.352384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.353756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:42.354063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:42.354481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.383515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-352c8889-0347-47b1-8f5c-8c7837e4bba1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044759 Aug 24 15:54:42.384159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 651/1275] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:42.425948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:42.428277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:42.436391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:42.436877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:42.437315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.438011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:42.438465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:42.438890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.468832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-455d29bd-4d5d-471c-b7e6-ace50be7e356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Aug 24 15:54:42.469391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 625/1276] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:42.877207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:42.879381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:42.885785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:42.886273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:42.886711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.887407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:42.887897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:42.888325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:42.919617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d407118-daa3-4eec-b6ee-83a379aac184 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Aug 24 15:54:42.920201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 652/1277] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:43.032251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:43.034454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:43.040675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.040992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.041427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.042120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.042569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.042989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.072818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e7ceb8b7-b446-473a-8330-9d546fa62524 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 24 15:54:43.073414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 626/1278] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:43.396163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:43.398312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:43.405799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.406294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.406726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.407429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.407932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.408360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.438702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-28099a99-d78d-41b8-b415-40f76e62c752 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046603 Aug 24 15:54:43.439322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 653/1279] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:54:43.480595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:43.482906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:43.489285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.489767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.490206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.491072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.491527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.491984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.522462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-84100d5c-108a-4baa-b6ff-66f155fb6f42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Aug 24 15:54:43.523088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 627/1280] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:43.932341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:43.934505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:43.940608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.941090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.941522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.942214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:43.942663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:43.943081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:43.973220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8bf3c8ae-4c18-4c4c-8393-ef43ec4d4b6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Aug 24 15:54:43.973769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 654/1281] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:44.085593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:44.087736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:44.093933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.094439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.094890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.095555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.096056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.096473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.125282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a252005c-0280-415f-bb72-9a015062a10c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Aug 24 15:54:44.125833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 628/1282] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:44.451656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:44.453834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:44.460328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.460813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.461251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.461949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.462965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.463399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.494518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-105f2a90-09f7-4235-b501-34aa5b32c986 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045827 Aug 24 15:54:44.495085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 655/1283] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:44.535613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:44.537757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:44.544619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.545097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.545531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.546223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.546674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.547101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.576178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-274cd380-86df-47c5-9b60-ee2e3519c181 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Aug 24 15:54:44.576738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 629/1284] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:44.985463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:44.987618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:44.994429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.994921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.995355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.996075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.996524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.996971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.025766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-487162a5-c0f9-4fe5-899b-e33a6e3f6957 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Aug 24 15:54:45.026315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 656/1285] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:45.137575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:45.139756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:45.145685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:45.146160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:45.146594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.147295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:45.147800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:45.148230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.180523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3756e358-fa93-43cc-8c1d-44b72dee8331 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Aug 24 15:54:45.181207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 630/1286] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:45.507084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:45.510095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:45.516569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:45.517059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:45.517492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.518183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:45.518636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:45.519059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.550699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-11df5ad5-066f-4848-86bf-f6c1fe21217c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047590 Aug 24 15:54:45.551261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 657/1287] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:45.588186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:45.590687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:45.597105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:45.597588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:45.598057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.598763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:45.599203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:45.599652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:45.629625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b96915e4-a72d-4ca6-8af9-6f9fc3cf43f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Aug 24 15:54:45.630183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 631/1288] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:46.037362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:46.039513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:46.046118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.046615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.047052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.047787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.048245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.048674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.078081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7c249059-1e5f-43fc-9df9-b958d0994810 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Aug 24 15:54:46.078639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 658/1289] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:46.198991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:46.201165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:46.207137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.207607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.208069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.208751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.209199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.209618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.239087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-27e0863e-0dc8-426a-bd13-24684757cb4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Aug 24 15:54:46.239653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 632/1290] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:46.564548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:46.566946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:46.573565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.574042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.574503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.575189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.575663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.576077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.578380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:46.606997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dfa1fc92-cdb6-41ee-895f-287b32d21f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046642 Aug 24 15:54:46.607546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 659/1291] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:46.642583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:46.644923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:46.652453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.652942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.653385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.654104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.654543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.654971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.685548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-726de572-023c-438a-a35d-004133227391 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Aug 24 15:54:46.686111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 633/1292] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:47.090924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:47.093171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:47.099135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.099559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.100099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.100790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.101245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.101668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.131746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-46b5a441-8c57-4eea-ae28-e4a50c4fbaf3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Aug 24 15:54:47.132306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 660/1293] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:47.252109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:47.254238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:47.260877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.261386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.261825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.262587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.263118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.263541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.293694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8bb2eb1f-e457-4bee-9953-f960d34f9140 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Aug 24 15:54:47.294258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 634/1294] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:47.620174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:47.622307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:47.628790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.629269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.629698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.630385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.630832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.631251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.660968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4a46d1a1-c8b6-4ece-aa34-cb1dfe96f52e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045515 Aug 24 15:54:47.661526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 661/1295] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:47.698108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:47.700955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:47.707520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.708042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.708481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.709184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.709635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.710059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.740242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-97de350f-7881-4502-bc7f-fc70035f2280 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Aug 24 15:54:47.740826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 635/1296] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:48.144869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:48.147039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:48.153880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.154376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.154859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.155607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.156137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.156569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.191215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-42534d91-1adf-4962-8df0-b7dcc4948d3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050191 Aug 24 15:54:48.191726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 662/1297] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:48.306682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:48.308859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:48.314812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.315295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.315764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.316462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.316920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.317382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.348054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-709ff290-c3ff-4852-8d2b-9ab42d50ade3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Aug 24 15:54:48.348606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 636/1298] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:48.674034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:48.676196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:48.683161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.683665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.684089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.684777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.685227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.685651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.714862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a778fc15-55cb-4942-8a5d-c91bb7687e07 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044614 Aug 24 15:54:48.715416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 663/1299] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:48.752881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:48.755197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:48.766108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.767508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.768014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.768760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.769222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.769654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.784684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:48.800540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-735c397e-b04c-47f9-918d-36072d07d338 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051565 Aug 24 15:54:48.801099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 637/1300] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:49.203354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:49.205591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:49.211501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.212168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.212608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.213334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.213785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.214209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.246002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b7fcd1ee-353a-4e30-8c9d-69ad47955846 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 Aug 24 15:54:49.246571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 664/1301] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:49.360693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:49.362751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:49.368944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.369413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.369850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.370542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.370998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.371423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.400304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-deeeb6fe-c7eb-4427-948b-a4acd64d8859 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 Aug 24 15:54:49.400859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 638/1302] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:49.726433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:49.728635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:49.739935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.740419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.740849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.741547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.741994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.742412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.772044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc5968d7-5c7e-433f-a612-0947e6757db0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049584 Aug 24 15:54:49.772595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 665/1303] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:49.812869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:49.815051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:49.821500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.821500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.822397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.823086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:49.823545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:49.823980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:49.853274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-18806cb7-1d80-42a3-85b6-e296e30eff28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Aug 24 15:54:49.854048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 639/1304] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:50.257641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:50.260440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:50.273363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.273870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.274350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.275103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.275559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.276051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.309844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d1e7b345-4a86-4367-8ec5-6ac12b3d8c94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055971 Aug 24 15:54:50.310504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 666/1305] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:50.413019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:50.415853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:50.422132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.422612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.423049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.423785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.424344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.424758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.455070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0c46ea0a-efe5-454a-bdbe-517a16be60b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Aug 24 15:54:50.455657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 640/1306] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:50.785322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:50.787504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:50.795361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.795887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.796312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.797018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.797460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.797880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.828038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ca6c16db-a2e5-4ee2-94c7-078d3eb58793 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046663 Aug 24 15:54:50.828601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 667/1307] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:50.865532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:50.867735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:50.873713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.874194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.874630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.875322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:50.875832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:50.876265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:50.904962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-758da647-ea0b-4967-b1b9-e0b3ec1b8fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Aug 24 15:54:50.905516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 641/1308] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:51.322816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:51.324997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:51.330872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.331348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.331819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.332545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.332995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.333412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.362843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-43efd347-0095-4754-a932-a2339177e898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Aug 24 15:54:51.363305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 668/1309] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:51.468447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:51.470638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:51.477276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.478061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.478521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.479274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.479767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.480205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.510794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e0aa453-a405-418a-bf06-f8b35bb810d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Aug 24 15:54:51.511357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 642/1310] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:51.841130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:51.843300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:51.849895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.850379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.850818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.851533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.852013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.852445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.885306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-937d1e8e-3525-4622-bef6-112dde5a57c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048812 Aug 24 15:54:51.885878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 669/1311] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:51.917496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:51.919679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:51.925746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.926213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.926649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.927343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:51.927824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:51.928251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:51.958095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-08c5cb20-cba8-4211-886b-bd519c0c61e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 15:54:51.958650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 643/1312] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:52.375151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:52.377424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:52.383489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.384011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.384450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.385233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.385689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.386118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.416465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f3154f09-6ef6-4564-8ada-cf0f70a57b03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Aug 24 15:54:52.416949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 670/1313] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:52.523297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:52.526139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:52.532658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.533140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.533573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.534266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.534716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.535140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.564200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b61b552a-ba09-4e20-be90-b68e040d5b5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Aug 24 15:54:52.564756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 644/1314] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:52.897689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:52.900413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:52.906827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.907309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.907772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.908463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.908911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.909333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.938630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-79cbe1fc-59e2-4df1-9e3e-9609b5f76389 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044853 Aug 24 15:54:52.939198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 671/1315] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:52.970645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:52.972824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:52.978770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.979254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.979726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:52.980418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:52.980865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:52.981286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.010312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-00b468d7-d833-4dda-b881-17531b69c352 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043254 Aug 24 15:54:53.010907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 645/1316] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:53.428678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:53.430873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:53.437642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:53.438182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:53.438623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.439334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:53.439850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:53.440254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.469858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e8d18b71-76dd-4ce2-a909-233519af9f80 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Aug 24 15:54:53.470346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 672/1317] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:53.576222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:53.578421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:53.585567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:53.586045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:53.586478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.587183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:53.587792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:53.588425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.618752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9781634-ecbd-4c5b-8640-344683930dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 24 15:54:53.619313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 646/1318] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:53.951446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:53.953722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:53.960444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:53.960929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:53.961367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.962099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:53.962549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:53.962972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:53.992371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b7096fb-f69b-4f14-9614-9b1843367677 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045676 Aug 24 15:54:53.992963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 673/1319] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:54.022261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:54.024493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:54.030804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.031282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.031763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.032459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.032905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.033322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.062377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b66b89ca-1f0c-471f-9cc4-69f99a67ddde tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Aug 24 15:54:54.062930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 647/1320] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:54.481901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:54.484764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:54.490837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.491332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.491800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.492508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.492967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.493394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.524250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22c00219-653e-4a33-aa63-f4f8ab24d5bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Aug 24 15:54:54.524818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 674/1321] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:54.631807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:54.634014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:54.640833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.641390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.641954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.642676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.643134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.643562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.675651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2eadf96e-0c35-451a-ad96-4c1e67499436 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Aug 24 15:54:54.676246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 648/1322] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:55.006109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:55.008325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:55.014850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.015315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.015784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.016490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.016948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.017383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.042854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:55.048402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b759f8b-a86b-42e7-939a-6313ab7ff2cb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046799 Aug 24 15:54:55.049244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 675/1323] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:55.075118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:55.077335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:55.083286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.083832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.084265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.084953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.085395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.085813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.115140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3a76da20-46ae-4164-a287-06cce78968a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Aug 24 15:54:55.115705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 649/1324] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:55.537600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:55.539756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:55.545973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.546452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.546882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.547585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.548063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.548499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.586353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5de8a393-37c9-4544-879e-f81fad092797 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052604 Aug 24 15:54:55.586847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 676/1325] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:55.688603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:55.690767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:55.697226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.697704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.698706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.699443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.699916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.700340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.729886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2197ded1-fb78-4851-838a-2c5a660d6005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 24 15:54:55.730442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 650/1326] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:56.061920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:56.064147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:56.070612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.071107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.071539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.072267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.072718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.073745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.102922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7c6fb0f8-49cf-43a2-b628-52fa79e74ad5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045897 Aug 24 15:54:56.103395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 677/1327] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:56.127128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:56.129318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:56.135298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.136917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.137363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.138063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.138522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.138953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.169738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f701453-a6f9-42ba-bcc7-12f357d37278 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Aug 24 15:54:56.170299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 651/1328] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:56.602723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:56.605237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:56.611225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.611746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.612191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.612922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.613382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.613811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.647199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3443ebc-5c07-485a-9b89-647513f70335 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Aug 24 15:54:56.647771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 678/1329] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:56.742168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:56.744336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:56.751883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.752371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.752812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.753513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.753971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.754401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.784516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9996f5d-e8eb-4ee6-a301-74ca960d40fa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Aug 24 15:54:56.785071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 652/1330] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:57.114716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:57.116966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:57.125114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.125606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.126045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.126783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.127272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.127734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.159175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d7a9636-81c6-4b3b-ae86-c137b0ded34b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048417 Aug 24 15:54:57.159780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 679/1331] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:57.181607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:57.184404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:57.190295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.190774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.191212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.191945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.192399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.192880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.221625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-293dbc21-5e38-4a35-b201-ca5e0a3dd08e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Aug 24 15:54:57.222180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 653/1332] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:57.660344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:57.662579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:57.669408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.669819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.670249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.670938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.671387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.671851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.701170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4a61969f-e0a1-442f-8150-71ae99b9f9f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 24 15:54:57.701737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 680/1333] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:57.797421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:57.799625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:57.806016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.806496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.806925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.807656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.808282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.808709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.811012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:57.843200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f493bc3b-d0c4-43ad-8b18-e8efb4567e63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049635 Aug 24 15:54:57.843800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 654/1334] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:58.171867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:58.174023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:58.179982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.180487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.181014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.181715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.182173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.182653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.211482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c8b1fbc-e5cb-4989-ad84-3fc3260dfb08 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043609 Aug 24 15:54:58.212072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 681/1335] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:58.234326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:58.236528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:58.242523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.243013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.243451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.244178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.244636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.245995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.280363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-76278d1c-4266-481c-bff7-82900be6f3c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050470 Aug 24 15:54:58.281173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 655/1336] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:58.712517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:58.714772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:58.721563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.721969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.722405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.723089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.723537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.723986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.754295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc7a29c9-2b61-43fa-b736-51b56920ff64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045694 Aug 24 15:54:58.754844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 682/1337] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:58.855155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:58.857369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:58.863738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.864226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.864658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.865348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:58.865804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:58.866229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:58.903088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b130df35-bd47-40b2-953b-a08a859235d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052463 Aug 24 15:54:58.903669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 656/1338] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:59.225544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:59.227724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:59.234346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.234826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.235258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.235986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.236441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.236858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.266101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d01d616-8fcf-4ae0-a594-56d11da3a0b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044498 Aug 24 15:54:59.266660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 683/1339] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:54:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:54:59.293362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:59.295567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:59.301569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.302050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.302489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.303188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.303652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.304089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.332883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ef9bebc5-e108-4c86-b0b2-78eeec91f240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Aug 24 15:54:59.333450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 657/1340] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:59.767225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:59.769446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:59.776205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.776621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.777183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.777753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.778204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.778626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.808542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b3e498f2-0777-41e0-8959-0625a5da32c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Aug 24 15:54:59.809110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 684/1341] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:54:59.915044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:59.917347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:59.924084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.924573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.925017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.925716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.926171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.926597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.960213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d84e5ca3-6320-4bd4-aaba-df3e2fb7fd91 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049009 Aug 24 15:54:59.960806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 658/1342] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:54:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:00.280036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:00.282352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:00.288561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.289049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.289483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.290190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.290643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.291070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.322133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b65ae607-6bf2-4117-a637-218f18e28680 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047679 Aug 24 15:55:00.322704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 685/1343] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:00.345849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:00.348046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:00.354046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.355668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.355889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.356791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.357597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.358371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.397713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cbbb25ca-4bbb-4487-873c-5c3d27659ca3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055911 Aug 24 15:55:00.398340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 659/1344] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:00.822777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:00.825877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:00.832984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.833403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.833839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.834547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.835005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.835427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.867514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1ff9e395-f5c4-4a0f-90ce-906b664b45b2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050379 Aug 24 15:55:00.868117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 686/1345] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:00.976998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:00.979187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:00.982257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:00.987492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.988131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.988574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.989291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.989748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.990175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.021111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8ddbf1ff-bc6b-4ff8-ad88-3f2871f13cc1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Aug 24 15:55:01.021673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 660/1346] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:01.334643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:01.336885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:01.338836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:01.344911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.345341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.345782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.346952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.347378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.377704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-340481ce-c675-4a7c-a562-da9b820e2d0e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047052 Aug 24 15:55:01.378254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 687/1347] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:01.410948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:01.413130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:01.419087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.419569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.420046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.420742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.421197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.421621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.451190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a1f808c2-6bc1-4766-ad69-dbde367256dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Aug 24 15:55:01.451765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 661/1348] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:01.880088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:01.882319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:01.889594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.890088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.890557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.891265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.891768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.892186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.922661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7c14cd8-6709-4b03-b147-c1746adc2992 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Aug 24 15:55:01.923958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 688/1349] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:02.033860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:02.036802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:02.043506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.044014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.044448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.045144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.045597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.046017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.076335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91ea2c2f-b841-4e37-ba5a-59695dbd15b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Aug 24 15:55:02.077258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 662/1350] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:02.390989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:02.393278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:02.399560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.400119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.400669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.402086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.402918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.403414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.434219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6551d71d-8da9-4d93-8f8e-68f52c5e1e81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047400 Aug 24 15:55:02.434785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 689/1351] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:02.462482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:02.465581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:02.471875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.472371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.472818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.473527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.473984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.474417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.505758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-911eb07b-7478-4e3d-9be0-f5e22c4a8d98 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Aug 24 15:55:02.506256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 663/1352] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:02.936102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:02.938252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:02.944821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.945311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.945748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.946456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.946910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.947337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.979151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5ddcc387-746e-4101-84d1-ce44f2413014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Aug 24 15:55:02.980036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 690/1353] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:03.088900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:03.091303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:03.097937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.098406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.098812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.099518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.100023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.100446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.130724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-61fc10d1-1da4-45da-8293-c4390a0b5620 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Aug 24 15:55:03.131333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 664/1354] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:03.449768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:03.451982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:03.458150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.458631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.459070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.459798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.460258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.460682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.490401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4078b5c-2790-4d9f-ab01-d3202f51ef2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047265 Aug 24 15:55:03.490955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 691/1355] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:03.518134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:03.520500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:03.527487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.528018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.528460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.529160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.529620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.530052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.560505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a604343e-a9c8-44c9-8120-e1921b851249 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Aug 24 15:55:03.561064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 665/1356] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:03.991783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:03.993853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:04.001562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.002052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.002491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.003195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.003674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.004111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.018786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:04.036142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-83fa7f78-5a55-4d5d-9713-c2b29397de57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048347 Aug 24 15:55:04.036711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 692/1357] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:04.143604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:04.145768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:04.152235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.153470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.153917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.154622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.155123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.155617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.185669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a9b9ec50-5fe2-4d32-9b08-a3953d0321a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Aug 24 15:55:04.186241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 666/1358] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:04.503455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:04.505664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:04.514245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.514735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.515202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.515915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.516381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.516812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.547616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b34406eb-3886-4435-9916-ea9b92083fc2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048253 Aug 24 15:55:04.548200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 693/1359] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:04.572674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:04.575526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:04.581633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.582110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.582543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.583228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.583714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.584137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.613970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5facf594-5815-42d3-a230-5d1cd4234cb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Aug 24 15:55:04.614522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 667/1360] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:05.049414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:05.051488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:05.057949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.058431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.058868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.059570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.060057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.060488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.096980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-68e5f12e-c4ca-476e-8070-0f6040707f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050995 Aug 24 15:55:05.096980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 694/1361] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:05.198074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:05.200524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:05.207020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.207500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.207978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.208681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.209134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.209563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.244591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71bcc534-b35f-4b24-9d59-b007fe2be9c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 Aug 24 15:55:05.245921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 668/1362] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:05.560573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:05.562737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:05.568768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.569245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.569682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.570370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.570822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.571243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.603592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-837e2d12-d116-4c0c-9a14-3280fb10e860 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047422 Aug 24 15:55:05.604097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 695/1363] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:05.626530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:05.631079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:05.637552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.638160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.638594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.639293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:05.639770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:05.640188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:05.669599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e3b43da-d4e3-4972-9fd3-388960cf1814 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Aug 24 15:55:05.670153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 669/1364] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:06.109974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:06.112188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:06.118700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.119128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.119569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.120302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.120763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.121194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.152296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d17b97c-d8e8-4549-9431-501f6bcf5eb4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047425 Aug 24 15:55:06.153447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 696/1365] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:06.258522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:06.260715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:06.267225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.267739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.268172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.268861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.269309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.269737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.294460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:06.301376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d1e6bda-03b0-4558-9155-dd014ac7845b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Aug 24 15:55:06.301943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 670/1366] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:06.616367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:06.618602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:06.628539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.629076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.629519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.630423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.630910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.631342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.666295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b6168c3e-42c6-4ab2-8921-b9f46075948e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053932 Aug 24 15:55:06.666879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 697/1367] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:06.682527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:06.686338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:06.692695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.693375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.693821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.694537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.694997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.695423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.727930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91a56bda-872f-41e4-b999-cf33f5346313 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049787 Aug 24 15:55:06.728513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 671/1368] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:07.166445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:07.170335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:07.178690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.179221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.179696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.180425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.180891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.181314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.212927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-634e61c4-0a3b-4437-86d7-0e7efa84fe5f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051428 Aug 24 15:55:07.213486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 698/1369] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:07.313831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:07.316111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:07.322414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.322897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.323334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.324067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.324549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.324980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.354745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb0d8629-1e5b-4912-96c6-d7a2484edb8a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044886 Aug 24 15:55:07.355296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 672/1370] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:07.679412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:07.681590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:07.687854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.688350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.688787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.689494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.689949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.690377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.721260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9ae0d14c-5695-40f2-96ac-04aa61e11343 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045879 Aug 24 15:55:07.721832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 699/1371] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:07.741664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:07.743836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:07.749887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.750374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.750815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.751516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.752071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.752440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.782180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c7a51943-bec7-49bd-9cc9-a85c7b4f7efa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 24 15:55:07.782747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 673/1372] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:08.231053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:08.233897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:08.241269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.241791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.242303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.243082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.243833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.244324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.279482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4df08a4f-b6b4-4be6-bf82-7abf9d9d9fa9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053210 Aug 24 15:55:08.284581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 700/1373] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:08.367723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:08.369906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:08.377137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.377617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.378054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.378756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.379208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.379663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.409031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-993f1485-478a-48a6-b27d-7d0e165c917d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Aug 24 15:55:08.409589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 674/1374] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:08.734697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:08.736887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:08.743160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.743660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.744111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.744813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.745260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.745678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.774307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-02e01396-820a-4d48-9317-a0d69f109457 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044395 Aug 24 15:55:08.774850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 701/1375] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:08.795145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:08.797298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:08.805920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.808114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.808552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.809276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.809743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.810165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.839974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-54beb0b3-b071-4160-9da0-90cceeb99374 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049512 Aug 24 15:55:08.841297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 675/1376] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:09.291685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:09.293825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:09.300259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.300735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.301185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.301902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.302372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.302790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.331695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f0b25de7-dd15-4ec3-b4d8-a04183aec9c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Aug 24 15:55:09.332237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 702/1377] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:09.421734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:09.423963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:09.430445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.430930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.431363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.432115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.432554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.432980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.462663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3c23b152-6c50-4410-9762-b8d131416040 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 24 15:55:09.463214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 676/1378] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:09.786748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:09.789009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:09.795565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.796096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.796533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.797225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.797678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.798156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.828682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-916256da-a34e-438a-858e-5cee47ddc3b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045953 Aug 24 15:55:09.829250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 703/1379] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:09.853076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:09.855275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:09.862498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.862920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.863364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.864109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.864568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.865001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.895324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3a586fb3-d537-4ef3-a1c6-99d15d954407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Aug 24 15:55:09.895919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 677/1380] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:10.345273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:10.347429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:10.353851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.354380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.354876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.355647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.356740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.357167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.386623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b3f733a8-7f81-44a9-ad66-568b30b648f1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Aug 24 15:55:10.387199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 704/1381] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:10.475868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:10.478003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:10.485576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.486046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.486483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.487199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.487697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.488144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.516782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6d2e55e-5233-410a-8124-814071c811e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 24 15:55:10.517327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 678/1382] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:10.842350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:10.844458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:10.850543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.851040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.851473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.852202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.852658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.853077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.882422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-43db738d-4a98-4c9b-aebd-fc1c0ea9521e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045092 Aug 24 15:55:10.882977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 705/1383] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:10.908201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:10.910365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:10.916312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.916798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.917234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.917931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:10.918518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:10.918933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:10.947927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e3d22fb1-d0bc-47ad-9835-2082e4475085 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Aug 24 15:55:10.948492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 679/1384] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:11.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:11.401443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:11.408388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.408886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.409329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.410047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.410506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.410932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.442319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa52f3bd-bdb8-40cd-841c-5b618c57361b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Aug 24 15:55:11.442882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 706/1385] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:11.529162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:11.531321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:11.537693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.538179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.538617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.539373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.539858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.540283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.570291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-db242651-3b36-43e5-91d4-efa166757ed6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Aug 24 15:55:11.570842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 680/1386] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:11.895101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:11.897687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:11.904309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.904811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.905225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.905917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.906372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.906797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.936339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a9c68424-13a7-4188-adb0-d845e355e12e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045218 Aug 24 15:55:11.936926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 707/1387] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:11.960589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:11.962760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:11.969936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.970411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.970839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.971529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.972002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.972429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.003998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-961f30a1-116a-41bb-bc2f-d5a62af9ad04 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047241 Aug 24 15:55:12.004558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 681/1388] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:12.455340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:12.457414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:12.463764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:12.464241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:12.464670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.466281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:12.466984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:12.467428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.495985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-94d5f89a-d2e2-41a8-bb3b-4575b452d392 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Aug 24 15:55:12.497064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 708/1389] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:12.582941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:12.585134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:12.592035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:12.592521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:12.592965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.593697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:12.594159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:12.594619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.623718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a8c98d67-58a7-4b4f-8203-c09abc550b9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044668 Aug 24 15:55:12.624278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 682/1390] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:12.948580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:12.950745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:12.956795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:12.957281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:12.957724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.958417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:12.958872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:12.959300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:12.961633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:12.989800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-284712aa-2d51-4f72-aeb7-b40bb5c79364 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Aug 24 15:55:12.990352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 709/1391] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:13.016791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:13.019082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:13.025048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:13.025532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:13.025967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:13.026669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:13.027115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:13.027539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:13.056893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-29372224-7f69-4485-a827-bcb8ecbbe641 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Aug 24 15:55:13.057369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 683/1392] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:13.509230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:13.511434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:13.518744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:13.519245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:13.519716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:13.520422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:13.520880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:13.521310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:13.552760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d90008f3-a118-4f76-a72d-b53fbac9a9e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047447 Aug 24 15:55:13.553319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 710/1393] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:13.636056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:13.638706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:13.646928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:13.647427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:13.647924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:13.648804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:13.649272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:13.649709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:13.679973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-575b38e3-7b5f-4a15-bac5-069f29faa2b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048020 Aug 24 15:55:13.680530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 684/1394] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:14.002037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:14.004187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:14.010303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.010783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.011216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.011928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.013127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.013560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.047743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-814bf134-9ac8-412c-a52c-51c454ccaf42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049617 Aug 24 15:55:14.048296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 711/1395] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:14.069834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:14.071995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:14.078557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.079032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.079470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.080274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.080728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.081157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.109736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-814b58ec-cfbe-48af-95c2-fd6023164165 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Aug 24 15:55:14.110231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 685/1396] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:14.567893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:14.570043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:14.576600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.577082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.577519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.578242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.578699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.579124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.609859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-55c2fa7c-8917-46aa-8c9c-1ae01a6532e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Aug 24 15:55:14.610476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 712/1397] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:14.692653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:14.694778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:14.701502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.701974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.702407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.703091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:14.703538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:14.703984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:14.734110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc0026fa-596a-4c1e-856e-ca4073391e4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045354 Aug 24 15:55:14.734671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 686/1398] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:15.060260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:15.062539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:15.068534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.069019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.069452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.070152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.070610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.071034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.101839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0271877f-6a4b-44a0-8953-3d3c4e13de5e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045652 Aug 24 15:55:15.102323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 713/1399] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:15.121986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:15.124192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:15.130069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.130542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.130980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.131689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.132137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.132554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.146370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:15.163766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b80f58e5-8884-4f5d-b478-4b368288cbcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Aug 24 15:55:15.164346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 687/1400] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:15.624089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:15.626156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:15.632699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.633189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.633627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.634330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.634788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.635215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.664838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9db73f45-078c-4f85-b748-4a0909983983 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Aug 24 15:55:15.665403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 714/1401] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:15.746480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:15.749210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:15.755609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.756117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.756645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.757297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:15.757686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:15.758103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:15.787663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a712d681-66d8-4e1d-8dff-f0c51eb68af5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Aug 24 15:55:15.788218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 688/1402] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:16.114258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:16.116446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:16.123223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.123744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.124202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.124903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.125359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.125785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.163302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad5f11af-7341-4b7e-9772-e5034079e3a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052956 Aug 24 15:55:16.163912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 715/1403] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:16.175905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:16.178039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:16.184000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.185196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.185635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.186324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.186779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.187201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.215218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c934e301-d9fd-438c-9946-c987eada6a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 Aug 24 15:55:16.216795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 689/1404] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:16.677619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:16.679711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:16.686388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.686866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.687290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.688027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.688497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.688900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.719704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2bdfccfe-88c0-4ee8-9ce3-4b730743da5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Aug 24 15:55:16.720530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 716/1405] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:16.799831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:16.802034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:16.808431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.808907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.809436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.810134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:16.810584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:16.811018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:16.842230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7aaa2274-441d-414c-9391-743f4dcdf329 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Aug 24 15:55:16.842790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 690/1406] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:17.176084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:17.178259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:17.184748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.185229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.185661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.186353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.186804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.187227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.216726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9079a27a-aff7-4b0d-a561-3b2b660d323d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044305 Aug 24 15:55:17.217285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 717/1407] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:17.228312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:17.230493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:17.236765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.237297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.237844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.238622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.239141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.239614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.269223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-798d564b-b450-4b9d-89f5-499d697765cc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Aug 24 15:55:17.269788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 691/1408] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:17.734648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:17.736786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:17.743311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.743978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.744293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.745024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.745483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.745912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.775455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-27380d73-1501-4dc4-8e39-fd2f131934cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Aug 24 15:55:17.776042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 718/1409] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:17.854527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:17.857519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:17.864001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.864482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.864917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.865611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:17.866056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:17.866473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:17.895409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-867ca857-cba3-41a4-9883-ddc21f308b14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 24 15:55:17.896295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 692/1410] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:18.230848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:18.234020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:18.240475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.241027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.241575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.242368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.242820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.243328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.276497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e9b242c1-ef85-4e1e-bb08-b38bfd4db25f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049755 Aug 24 15:55:18.277136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 719/1411] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:18.283379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:18.285646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:18.291497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.292018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.292454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.293192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.293679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.294253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.322416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-07de816e-dd85-479a-8bf5-452e75bc0d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Aug 24 15:55:18.322967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 693/1412] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:18.789509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:18.792320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:18.800683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.801365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.801808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.802518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.804446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.805941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.843177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd20e826-a303-4106-af5c-80db5ff04d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058141 Aug 24 15:55:18.843884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 720/1413] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:18.908921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:18.911067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:18.918047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.918591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.919121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.919874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:18.920331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:18.920799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:18.954860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-361bf121-586b-4954-b8a7-4aa317b08484 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049814 Aug 24 15:55:18.955503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 694/1414] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:19.290347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:19.292606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:19.298468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.298949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.299384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.300464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.300923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.301348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.332095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ecd54af4-ffb5-4a7d-bceb-03ae2e0c89d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045656 Aug 24 15:55:19.332664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 721/1415] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:19.334605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:19.336798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:19.343376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.343839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.344282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.344995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.345449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.345877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.374852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e84dbfc7-d465-480c-b26e-bdddb62d45f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Aug 24 15:55:19.375334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 695/1416] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:19.854554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:19.857882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:19.864372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.864859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.865296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.865995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.866452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.866879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.898132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7ae8a59f-b304-4940-be78-054a3ade6920 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Aug 24 15:55:19.898652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 722/1417] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:19.967206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:19.969462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:19.976415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.976901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.977338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:19.978038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:19.978492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:19.978922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.008816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a031785-a68e-48ae-b851-84c73fff78a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046293 Aug 24 15:55:20.009388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 696/1418] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:20.346067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:20.348178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:20.354074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:20.354550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:20.354981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.355687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:20.356182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:20.356594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.385767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f80c803a-e946-4399-b51e-efecc9b2631c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045211 Aug 24 15:55:20.386325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 723/1419] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:20.386772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:20.389542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:20.395478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:20.395994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:20.396432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.397162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:20.397613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:20.398037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.428112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-16368ba2-bb4f-4c5e-ac05-b1b8b73c7596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045564 Aug 24 15:55:20.428668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 697/1420] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:20.910528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:20.912721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:20.919768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:20.920254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:20.920684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.921387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:20.921842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:20.922266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:20.952381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-736d8cb9-c1c5-4c70-ba2a-9e08fa0648d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045726 Aug 24 15:55:20.952949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 724/1421] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:21.020878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:21.023020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:21.029535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.030019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.030456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.031152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.031610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.032060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.061467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ebac1e5c-52a2-4381-b53a-44c03a8276ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Aug 24 15:55:21.062058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 698/1422] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:21.398807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:21.401033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:21.407838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.408326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.408762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.409459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.409913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.410339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.435192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:21.440345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:21.440731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-60dd4054-5086-4a8b-9c1c-de18b2033487 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045950 Aug 24 15:55:21.441302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 725/1423] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:21.442577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:21.448957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.449457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.450422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.451391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.452477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.452477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.482136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0a8e4b1d-4866-45f2-9ef3-ce47463d0dae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046279 Aug 24 15:55:21.482690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 699/1424] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:21.965234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:21.968228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:21.974575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.975058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.975494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:21.976216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:21.976668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:21.977091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.006122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b2fc10c6-4b40-4c97-8120-f6e491e9a307 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Aug 24 15:55:22.006679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 726/1425] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:22.073945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:22.077171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:22.083180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:22.083698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:22.084144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.084850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:22.085311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:22.085742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.116534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c53befc4-31e6-4123-acd4-ae405fb73d69 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Aug 24 15:55:22.117089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 700/1426] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:22.453825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:22.456100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:22.462065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:22.462548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:22.462979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.463695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:22.464152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:22.464599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.494170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-30f85b0b-dc31-4927-81d0-5ba3f6ad26c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Aug 24 15:55:22.494377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:22.494733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 727/1427] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:22.496562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:22.503645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:22.504152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:22.504592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.505299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:22.505759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:22.506189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:22.535668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a4ef42ce-7c27-4cf1-99e2-ce8f31ebe477 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Aug 24 15:55:22.536143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 701/1428] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:23.019024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:23.021256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:23.027665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.028676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.029088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.029771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.030222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.030642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.060048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-88f49055-72c9-444c-8d39-1ca374dec183 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Aug 24 15:55:23.060615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 728/1429] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:23.128913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:23.131049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:23.137157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.137676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.138106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.138805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.139605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.139857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.171033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0cac6b86-8c74-47ff-ba5c-efab1e824d14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Aug 24 15:55:23.171584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 702/1430] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:23.507094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:23.509291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:23.515779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.516273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.516706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.517407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.517860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.518278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.547872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:23.548273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b9716a32-7dca-40a5-8712-ca40f42ebc68 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045221 Aug 24 15:55:23.548842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 729/1431] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:23.550165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:23.556612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.557100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.557539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.558247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:23.558699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:23.559128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:23.587675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-747c2393-ea89-4361-83b3-82198fb9a8f4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Aug 24 15:55:23.588238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 703/1432] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:24.072922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:24.075562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:24.082178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.082655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.083082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.083808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.084261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.084678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.099790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:55:24.100291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 15:55:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments (ip 10.222.0.102) !!! Aug 24 15:55:24.119101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-08e9b02e-30cd-4a58-b16c-5f970c368368 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050220 Aug 24 15:55:24.119688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 730/1433] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:24.182800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:24.185748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:24.191926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.192405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.192838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.193577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.194387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.195277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.197969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:24.235258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7e980d06-d2e9-442f-96f2-fd450e518b56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056445 Aug 24 15:55:24.235852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 704/1434] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:24.561573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:24.565387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:24.572218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.572720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.573153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.573856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.574321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.574744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.601158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:24.603485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:24.609578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cd07d415-6be7-4a58-97ba-4b925a70b3c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052774 Aug 24 15:55:24.610360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 731/1435] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:24.614467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.614960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.615442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.616187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:24.616648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:24.617201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:24.649437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-00577796-d8d8-48af-82c2-8e699ed75044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052364 Aug 24 15:55:24.650004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 705/1436] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:25.132906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:25.135251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:25.142339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.142826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.143264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.143993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.144455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.144884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.175690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ea314f10-076d-4014-a750-999a62dd31e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046735 Aug 24 15:55:25.176267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 732/1437] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:25.248428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:25.250677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:25.257704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.258190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.258719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.259581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.260445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.261222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.294458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cf84d564-af55-4af0-b177-4bf48436e6e4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050933 Aug 24 15:55:25.295018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 706/1438] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:25.539769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:55:25.540007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 15:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:55:25.623240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:25.625403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:25.631272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.631776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.632215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.632906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.633355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.633774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.662549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aae4cd2a-8866-4493-882f-eb30ea30930d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044079 Aug 24 15:55:25.662776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:25.663107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 733/1439] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:25.664795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:25.672742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.673225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.673657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.674361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:25.674810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:25.675236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:25.703952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-be108a71-1fb8-4c90-91d1-606ca551248a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Aug 24 15:55:25.704531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 707/1440] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:26.188384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:26.190544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:26.196988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.197481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.197918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.198618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.199075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.199504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.230879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-93f8485c-25da-4e61-9fb8-f1e118210d57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046737 Aug 24 15:55:26.232158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 734/1441] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:26.307218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:26.310477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:26.318977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.319748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.320451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.321526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.322233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.322916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.354805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8695630c-0ef1-4d34-b27a-e569d7b4b5ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051722 Aug 24 15:55:26.355363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 708/1442] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:26.674862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:26.683676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:26.691185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.691689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.692123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.692812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.693261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.693688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.717126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:26.719345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:26.725666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.725864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eb3fd857-8a14-41a6-a07d-ae31a8cfd0e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055042 Aug 24 15:55:26.726146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.726444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 735/1443] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:26.726609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.727276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:26.727752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:26.728180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:26.757429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-29631613-b898-48e1-af1b-a043a3284188 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Aug 24 15:55:26.757979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 709/1444] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:27.243930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:27.246069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:27.253165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.253645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.254072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.254755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.255201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.255623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.285308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d03c179d-604e-4ff4-bc01-d3f878cf2bed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 24 15:55:27.285865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 736/1445] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:27.366597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:27.368811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:27.370725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:27.377071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.377562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.378005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.378703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.379427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.380036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.410192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1dab5675-9078-45fd-88c9-69e971a82bea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047528 Aug 24 15:55:27.410742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 710/1446] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:27.739024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:27.741267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:27.743144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:27.748797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.749282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.749717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.750446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.750904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.751327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.770108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:27.772293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:27.779623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.780296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.780736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.781443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:27.781572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-16bc53a6-34f2-46c5-b48c-019dca888933 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046629 Aug 24 15:55:27.782049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:27.782157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 737/1447] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:27.782490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:27.812993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d732ef1d-cf2b-41e9-95b4-fca27baadb5d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Aug 24 15:55:27.813540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 711/1448] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:28.297888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:28.300027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:28.306560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.307048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.307487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.308210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.308668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.309098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.338092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-650ee94d-517e-43cf-ba8f-6ee2366bb570 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Aug 24 15:55:28.338656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 738/1449] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:28.422472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:28.424673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:28.430960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.431482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.431927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.432635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.433092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.433522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.461725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58ea17b1-ce5c-4ee0-8f10-81c50d05b1ec tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Aug 24 15:55:28.462278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 712/1450] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:28.794242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:28.796479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:28.802597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.803093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.803528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.804250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.804704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.805131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.826826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:28.829126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:28.835277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e0cc7fda-5db2-4e50-8dc1-0436a38a275b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045152 Aug 24 15:55:28.835604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.835882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 739/1451] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:28.836124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.836562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.837262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:28.837715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:28.838139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:28.869202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-99415bb2-86d2-4d1e-a909-2ffd08341c15 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047767 Aug 24 15:55:28.869762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 713/1452] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:29.351217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:29.353305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:29.360464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.360944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.361375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.362064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.362514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.362932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.398032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-46810e05-9d84-477b-a13b-388c3ab0946f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050780 Aug 24 15:55:29.398588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 740/1453] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:29.474620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:29.476791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:29.483452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.483959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.484389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.485081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.485530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.485951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.515073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2443e196-ada5-437b-a912-6bd4e3259c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Aug 24 15:55:29.515611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 714/1454] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:29.848952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:29.851077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:29.857683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.858155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.858585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.859263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.859730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.860152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.881704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:29.884050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:29.889805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-49a712e2-26d7-4aa8-9733-81e229c7a748 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044852 Aug 24 15:55:29.890391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 741/1455] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:29.890591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.891030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.891466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.892206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:29.892660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:29.893084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:29.924151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1b14eeb0-a17a-415a-8e61-aca0b0ed2b5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Aug 24 15:55:29.924705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 715/1456] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:30.411156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:30.413330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:30.420110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.420623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.421059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.421760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.422216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.422699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.436820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:30.453874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bca8e984-897d-401c-984f-e0de0e412cde tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Aug 24 15:55:30.454432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 742/1457] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:30.527026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:30.529392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:30.535398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.535915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.536392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.537088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.537540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.537961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.568322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-253a8c57-58e2-4593-b4d3-99d6ef36f779 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 24 15:55:30.568879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 716/1458] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:30.902167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:30.904418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:30.910398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.910879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.911315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.912038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.912495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.912915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.937392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:30.939609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:30.943506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22256ee3-b23a-4bdd-8e63-ee2be1fbddec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045299 Aug 24 15:55:30.944129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 743/1459] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:30.946060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.946549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.946995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.947732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:30.948195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:30.948627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:30.978611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1f251e7f-ec96-440a-8edf-8a7f195b218d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 24 15:55:30.979169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 717/1460] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:31.467361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:31.469576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:31.476061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:31.476549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:31.476989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:31.477686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:31.478144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:31.478578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:31.508032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-62981e2b-bcc7-4844-a05b-cdda770ac835 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Aug 24 15:55:31.508597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 744/1461] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:31.581171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:31.583379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:31.589352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:31.589838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:31.590278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:31.592417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:31.592889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:31.593321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:31.623003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3dc1ff48-11fa-428e-a3da-880f808dc7ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Aug 24 15:55:31.623572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 718/1462] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:31.956816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:31.958959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:31.964923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:31.965410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:31.966425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:31.968069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:31.968533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:31.968963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:31.991938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:31.994116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:31.999779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b36793c-921e-4949-9384-6d71496e4908 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046876 Aug 24 15:55:32.000362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 745/1463] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:32.001223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:32.001715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:32.002151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:32.002858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:32.003314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:32.003777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:32.037738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aaf47d25-f68c-454b-a364-6e563bec0680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049683 Aug 24 15:55:32.038295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 719/1464] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:32.520019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:32.522067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:32.528593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:32.529076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:32.529502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:32.530188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:32.530632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:32.531050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:32.561301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4f1702c6-e337-456c-ab58-ec8514670620 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Aug 24 15:55:32.561858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 746/1465] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:32.634342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:32.636526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:32.642566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:32.643051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:32.643491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:32.644227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:32.644688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:32.645117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:32.670198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:32.675874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a6ac1504-275f-4546-aa3e-be234dda50c5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045517 Aug 24 15:55:32.676442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 720/1466] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:33.016431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:33.020098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:33.030009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.030771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.031210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.031947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.032400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.032859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.049825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:33.052123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:33.058431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.058914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.059346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.060592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.061044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.061468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.063060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c0dbfcf0-ed81-4cf3-8788-01348d54d12f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052931 Aug 24 15:55:33.063902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 747/1467] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:33.093303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-98bf4563-daa6-4020-aabc-1788c88a5e87 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047779 Aug 24 15:55:33.093858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 721/1468] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:33.573553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:33.575955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:33.582308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.582788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.583218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.583926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.584382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.584802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.615206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-15abd015-29b8-4b41-b35a-5f57f0a8f96f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045526 Aug 24 15:55:33.615778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 748/1469] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:33.687908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:33.690049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:33.696093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.696583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.697027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.697733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:33.698329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:33.698804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:33.729381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-48b97a29-1980-4144-812e-a05206ec5880 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 24 15:55:33.729934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 722/1470] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:34.076005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:34.078138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:34.084061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.084530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.084959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.085645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.086095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.086511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.105508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:34.107612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:34.114022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.114500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.114932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.115620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.116097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.116517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.116951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4db08283-3d8e-492c-9aec-7bfd0f2aa7e6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045430 Aug 24 15:55:34.117520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 749/1471] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:34.145781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb37a3d5-1c48-4b1e-851c-f4872470a3ea tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Aug 24 15:55:34.146323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 723/1472] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:34.628278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:34.630363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:34.636838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.637315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.637746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.638436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.638881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.639299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.669782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-be68f1e9-29fc-4058-ad64-ff825c607ca8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Aug 24 15:55:34.670536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 750/1473] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:34.742478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:34.744671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:34.751481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.752005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.752441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.753163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:34.753615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:34.754037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:34.782467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9eb64a99-e424-424f-a4a6-449936f3029e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Aug 24 15:55:34.783017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 724/1474] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:35.129187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:35.131512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:35.138101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.138826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.139331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.140133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.140661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.141157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.160160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:35.161261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:35.168385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.168869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.169396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.171384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.171384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.171794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.176303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-791f7808-ffc0-4fb8-9305-7682e091f713 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051279 Aug 24 15:55:35.179671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 751/1475] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:35.202335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-59ba445b-6c3a-4266-8312-33074ca41fe7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Aug 24 15:55:35.202904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 725/1476] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:35.682370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:35.684561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:35.691161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.691677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.692117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.692829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.693270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.693695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.723707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-45e192ea-276e-488c-96d0-a4fa154f324c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Aug 24 15:55:35.724278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 752/1477] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:35.794639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:35.796801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:35.802932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.803422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.803891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.804615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:35.805101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:35.805529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:35.836143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2c1c9f66-33be-4441-b9b7-c0ca33064a59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Aug 24 15:55:35.836646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 726/1478] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:36.189258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:36.191435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:36.197398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.197880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.198314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.199035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.199487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.199948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.214419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:36.216571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:36.223220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.223739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.224174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.224866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.225314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.225734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.230089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-88d80714-1e97-4d0e-9b81-e4ddcad142db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045433 Aug 24 15:55:36.230653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 753/1479] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:36.257827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a61219f1-3299-4132-9cfd-3c1abc1fa2e6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047308 Aug 24 15:55:36.258633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 727/1480] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:36.736727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:36.738766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:36.745261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.745737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.746167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.746847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.747368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.747823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.776332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f768471-2b40-4bdf-8113-c0a16a343e4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Aug 24 15:55:36.776882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 754/1481] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:36.848430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:36.850571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:36.857223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.857893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.858434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.859199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:36.859876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:36.860388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:36.893267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f94a123c-d005-4190-95e5-3f52d93a4473 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048664 Aug 24 15:55:36.893836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 728/1482] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:37.245911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:37.248228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:37.254145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.254621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.255050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.255768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.256216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.256634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.270105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:37.272760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:37.280313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.280807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.281247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.281955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.282413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.282850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.287741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-23d2868e-57b8-4db9-9430-38899e9414f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045727 Aug 24 15:55:37.288311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 755/1483] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:37.313567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-63392f31-d37b-40d1-b229-c0ea7f3656d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047398 Aug 24 15:55:37.314117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 729/1484] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:37.789140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:37.791267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:37.797760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.798245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.798683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.799378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.799876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.800304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.830735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-281c3286-c877-42c0-abfd-287a5fe3b132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Aug 24 15:55:37.831289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 756/1485] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:37.906852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:37.909033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:37.914945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.915429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.915917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.916621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:37.917074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:37.917503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:37.947776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da57e840-2de5-412b-8ddb-8bff115e18af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Aug 24 15:55:37.948341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 730/1486] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:38.300258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:38.302694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:38.308704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.309181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.309610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.310928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.311376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.311833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.326763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:38.328919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:38.335234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.335750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.336185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.336888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.337336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.337755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.342884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c6b5286a-80d3-452c-ae15-cc6e0c68a7f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046500 Aug 24 15:55:38.343450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 757/1487] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:38.366830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-15592889-2929-4541-ab4e-904d4b4d9268 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Aug 24 15:55:38.367377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 731/1488] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:38.843613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:38.845770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:38.852356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.852848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.853286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.853991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.854449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.854878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.885247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b96c9844-605a-4ee1-8ba8-a9ec488713ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046732 Aug 24 15:55:38.885802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 758/1489] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:38.961077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:38.963298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:38.969746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.970297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.970831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:38.971551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:38.972031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:38.972489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.002939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4f9183cb-354a-461f-b7fc-001388a5a613 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Aug 24 15:55:39.003502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 732/1490] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:39.355346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:39.357598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:39.364339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:39.364828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:39.365267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.366021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:39.366428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:39.366854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.370439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:39.379711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:39.381861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:39.388163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:39.388646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:39.389077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.390329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:39.390854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:39.391284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.398784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ac906526-ce56-449f-9ba7-944741344bd4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047347 Aug 24 15:55:39.399364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 759/1491] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:39.421118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9e84d69e-c4bc-4af0-a678-171ee4896c9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Aug 24 15:55:39.421700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 733/1492] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:39.898854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:39.901049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:39.907583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:39.908102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:39.908538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.909237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:39.909688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:39.910114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:39.941521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e22a79b0-6181-414d-904f-c174901ce65b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046596 Aug 24 15:55:39.942098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 760/1493] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:40.015225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:40.017519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:40.025016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.025514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.025951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.026658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.027115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.027541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.062745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d28ac6ba-0996-4258-82e1-1a26b3653f34 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050406 Aug 24 15:55:40.063331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 734/1494] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:40.416616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:40.419409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:40.427917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.427917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.428280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.428931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.429475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.429959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.433797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:40.435986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:40.444457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.444952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.445392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.446495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.447410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.447881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.461374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7f14c564-f7a3-44d0-8d7b-eca2c303e68b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053042 Aug 24 15:55:40.461957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 761/1495] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:40.480005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d553224d-234c-4708-a8c0-f9ac5a427d71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050360 Aug 24 15:55:40.480561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 735/1496] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:40.953945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:40.956196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:40.962510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.962990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.963418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.964126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:40.964574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:40.965000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:40.994605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d8dca99-df54-4717-b576-efc72d520146 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Aug 24 15:55:40.995159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 762/1497] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:41.074946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:41.077208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:41.083177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:41.083689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:41.084135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:41.084834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:41.085287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:41.085715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:41.115372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6ce703a9-da29-4bd8-8d3f-931acb66c8e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Aug 24 15:55:41.115990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 736/1498] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:41.474845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:41.477009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:41.482885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:41.483371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:41.483834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:41.484525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:41.484975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:41.485423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:41.493515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:41.495668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:41.502527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:41.503019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:41.503479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:41.504220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:41.504675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:41.505101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:41.514436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-26d6fcd8-e97e-4912-a9ce-1a024b79fc15 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043558 Aug 24 15:55:41.515503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 763/1499] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:41.520309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:41.537035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c1d97af2-89e7-49e2-814b-9dae2eed12a5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047423 Aug 24 15:55:41.537593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 737/1500] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:42.006976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:42.009069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:42.016223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.016733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.017181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.017867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.018370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.018740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.048100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3fd211cd-7e9c-4435-9e49-497a26ea86e0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Aug 24 15:55:42.048902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 764/1501] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:42.130659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:42.132927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:42.139121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.139623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.140204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.141047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.141645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.142262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.179668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7190c444-961e-489a-ae91-40f9212f46b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052896 Aug 24 15:55:42.180217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 738/1502] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:42.527414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:42.529583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:42.535565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.536082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.536517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.537219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.537672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.538101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.549800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:42.551993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:42.558346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.558829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.559266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.560006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:42.560460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:42.560923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:42.568353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-367143bc-72dc-419b-b1c4-0d8b0b5b33cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044905 Aug 24 15:55:42.568951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 765/1503] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:42.591641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a1842679-fbdc-4578-a52e-61f27d9c02d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Aug 24 15:55:42.592274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 739/1504] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:43.060573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:43.063258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:43.070244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.070762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.071257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.072023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.072495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.072906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.103005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-89830714-2896-4bc0-83ff-d4719da0f4ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046456 Aug 24 15:55:43.103561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 766/1505] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:43.192649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:43.194772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:43.200761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.201240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.201669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.202616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.203085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.203497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.232898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7daf2804-df9d-4f83-a3b0-3d88e08ecc8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Aug 24 15:55:43.234106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 740/1506] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:43.583091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:43.585330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:43.591279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.591804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.592242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.593772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.594229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.594665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.604949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:43.607107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:43.613663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.614148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.614584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.615314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:43.615795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:43.616218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:43.625569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e0f118fa-71a8-4d0f-a142-4e615670e130 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046390 Aug 24 15:55:43.626304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 767/1507] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:43.646414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-33f55c46-aebd-48d9-83df-e8c007077978 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Aug 24 15:55:43.646972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 741/1508] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:44.115579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:44.117722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:44.124834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.125414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.125854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.126550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.127001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.127424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.158073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a262acff-6563-4f54-829c-5a6c89e32cd7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046554 Aug 24 15:55:44.158626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 768/1509] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:44.245875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:44.248069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:44.254850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.255334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.255803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.256499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.256954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.257406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.286418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e37a56ad-df5f-42d3-b01f-ea1b29f68ed9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Aug 24 15:55:44.286963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 742/1510] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:44.638698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:44.641167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:44.647136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.647617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.648082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.648777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.649230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.649652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.658568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:44.660745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:44.667323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.667860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.668303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.669009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:44.669464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:44.669893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:44.683232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c32ab32b-2e0e-4f1c-ad71-25d7bea2c59b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048936 Aug 24 15:55:44.683859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 769/1511] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:44.701586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eba203ec-2e55-4422-bd0b-fd0a1ebf3bec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Aug 24 15:55:44.702165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 743/1512] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:45.170473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:45.173201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:45.179611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.180124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.180562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.181259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.181712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.182141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.211911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3ca6de7e-5bd5-42ab-a4a0-1f6f31bde6ad tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 24 15:55:45.212465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 770/1513] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:45.299168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:45.301389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:45.307320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.307842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.308277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.308970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.309417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.309837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.340406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71d409f3-2997-4d9f-a848-29e6238a9b18 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Aug 24 15:55:45.341234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 744/1514] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:45.696622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:45.698763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:45.704697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.705180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.705607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.706294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.706746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.707164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.716712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:45.720027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:45.726472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.726967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.727408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.728178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:45.728639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:45.729068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:45.739813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5cfc799e-eeeb-40f5-8d7d-1bb7524ad2b9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047159 Aug 24 15:55:45.740380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 771/1515] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:45.759957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-03b849cd-8213-4df4-99b4-abe302f8ef0c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049576 Aug 24 15:55:45.760530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 745/1516] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:46.224771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:46.226827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:46.233201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.233706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.234137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.234830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.235284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.235864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.266124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c497bd2a-7358-453b-b95b-1dbdb06a2143 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 24 15:55:46.267022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 772/1517] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:46.353179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:46.355366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:46.362864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.363479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.364150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.365366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.365904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.366343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.396858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b700834d-e816-473b-987b-3d13ebcae592 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Aug 24 15:55:46.397422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 746/1518] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:46.752544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:46.754715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:46.760696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.761173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.761629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.762317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.762766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.763184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.771977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:46.774109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:46.781171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.782197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.782640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.783343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:46.783832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:46.784263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:46.793758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-326f2479-b5d4-48a9-b8d0-a25585e147ce tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045396 Aug 24 15:55:46.794338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 773/1519] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:46.814251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1917a0df-abe5-413e-a39c-a541789281e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046200 Aug 24 15:55:46.814838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 747/1520] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:47.279181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:47.281638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:47.288037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.288524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.288959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.289680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.290130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.290548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.320871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d81ae119-d2f6-42f1-a9d0-f3e0e9430063 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Aug 24 15:55:47.321437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 774/1521] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:47.408831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:47.411164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:47.417296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.417771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.418200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.418982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.419438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.419896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.449576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cf8fc393-26c0-48cb-abb5-97f0405edd51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Aug 24 15:55:47.450123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 748/1522] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:47.806229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:47.808412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:47.814635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.815202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.815659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.816351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.816795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.817214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.826469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:47.828641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:47.835121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.835600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.836082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.836779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:47.837225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:47.837642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:47.845879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:47.851333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0e927534-854b-49f9-a203-f4b6a5b27592 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049105 Aug 24 15:55:47.852191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 775/1523] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:47.869242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b38195c7-cfbd-4e68-af26-e0ffc73bf1c0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 Aug 24 15:55:47.869787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 749/1524] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:48.333714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:48.335813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:48.342345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.342840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.343539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.345252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.345597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.346028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.376173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-76870665-020b-48d8-99d3-aa40b8504879 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047028 Aug 24 15:55:48.376737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 776/1525] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:48.461202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:48.463342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:48.469537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.470001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.470457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.471147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.471595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.472039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.500896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1f8e74d1-980f-4aea-a58f-5151d70439ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Aug 24 15:55:48.501442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 750/1526] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:48.864708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:48.866859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:48.872916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.873464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.873921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.874600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.875079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.876168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.882335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:48.884493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:48.890859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.891342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.891834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.892537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:48.892990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:48.893415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:48.906075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc828617-a2a0-4765-a612-c1f27864bb62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046186 Aug 24 15:55:48.906964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 777/1527] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:48.922579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-03d5df9c-cb57-459e-a418-78c19f6cde35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Aug 24 15:55:48.923359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 751/1528] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:49.389542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:49.391891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:49.398342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:49.398825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:49.399264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:49.399992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:49.400451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:49.400881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:49.430848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-69386dc9-0146-483d-8b22-0ca2e20a2053 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Aug 24 15:55:49.431424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 778/1529] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:49.513335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:49.515597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:49.522278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:49.522781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:49.523256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:49.524011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:49.524467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:49.524900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:49.554369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-26246134-96de-421a-872e-c0af0b73f82f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Aug 24 15:55:49.554924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 752/1530] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:49.919298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:49.921505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:49.927772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:49.928265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:49.928697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:49.929391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:49.929839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:49.930257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:49.964553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cd8bc384-0f08-4e99-8151-164c84d6c13c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049270 Aug 24 15:55:49.965131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 779/1531] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:50.041568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:50.043717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:50.049785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.050262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.050695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.051388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.051883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.052303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.081583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-815ef5b0-6b63-4f63-b621-d9d4bbba866a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151075 Aug 24 15:55:50.082124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 753/1532] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:50.446872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:50.449058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:50.458238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.458729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.459164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.459938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.460392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.461080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.494190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6a34312-609d-4c7e-85b2-b07a3013b3d6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055476 Aug 24 15:55:50.494739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 780/1533] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:50.567163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:50.569320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:50.575497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.576013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.576457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.577143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.577598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.578021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.580430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:50.607545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7be6a6fe-6e84-4c93-b792-511c70b7706f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Aug 24 15:55:50.608122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 754/1534] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:50.977493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:50.979684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:50.986190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.986664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.987092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:50.987805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:50.988256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:50.988677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.017828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-377b641d-3cf3-4a58-8936-a1724143f1a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044285 Aug 24 15:55:51.018380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 781/1535] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:51.094028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:51.096801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:51.103242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:51.103689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:51.104129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.104823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:51.105277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:51.105704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.134625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f933a286-a7a9-4119-bb7d-b8a038de3866 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Aug 24 15:55:51.135207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 755/1536] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:51.507480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:51.509706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:51.516929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:51.517422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:51.517859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.518559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:51.519018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:51.519447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.548396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1a09ea13-b645-485f-9a0d-aaba6cb234d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 24 15:55:51.548949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 782/1537] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:51.620394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:51.622515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:51.629010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:51.629487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:51.629947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.630646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:51.631091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:51.631514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:51.661373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-00b9e547-dd1b-4ab3-94b9-027361c7d6fc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Aug 24 15:55:51.662060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 756/1538] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:52.030278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:52.032506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:52.038523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.039009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.039519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.040279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.040736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.041163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.072524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98888db4-a138-4a59-afbe-c1292f879870 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046172 Aug 24 15:55:52.073115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 783/1539] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:52.147451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:52.149639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:52.156076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.157325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.157863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.158555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.159004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.159422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.188735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-50f07587-815d-4018-9619-a9c64ba0a5e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Aug 24 15:55:52.189283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 757/1540] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:52.560867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:52.563355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:52.569662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.570151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.570643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.571341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.571828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.572259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.602526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-37d33468-e3fb-455d-a773-54af0b5caec4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Aug 24 15:55:52.603074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 784/1541] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:52.674348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:52.676658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:52.682693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.683183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.683608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.684350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:52.684797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:52.685211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:52.716061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d0a79d61-0a4a-4c0a-a453-6002ffa97d5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Aug 24 15:55:52.716624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 758/1542] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:53.085643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:53.087855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:53.094132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.094765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.095317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.096041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.096489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.096910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.126270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-26ccfde1-c331-4a53-8336-fea81d224c16 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044057 Aug 24 15:55:53.126826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 785/1543] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:53.201166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:53.203376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:53.210584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.211066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.211504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.212235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.212690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.213118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.241556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cd06b5d4-db4f-4e05-9f6b-4a51566e3522 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 24 15:55:53.242108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 759/1544] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:53.615814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:53.618180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:53.624634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.625114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.626216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.626994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.627452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.627905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.657068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-df77a56a-34e0-4fb2-b70e-bb7e0acd9bd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Aug 24 15:55:53.657637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 786/1545] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:53.729412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:53.731532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:53.733520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:53.739381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.739900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.740350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.741075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:53.741527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:53.741949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:53.770929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-345b7fd8-d9d8-41dd-bf73-0d85c5cf6e15 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Aug 24 15:55:53.771485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 760/1546] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:54.138225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:54.140857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:54.143478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:54.148885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.149364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.149792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.150485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.150932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.151349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.181814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-57e3b3a4-fcec-4602-8242-1d0ea02eca02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047543 Aug 24 15:55:54.182377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 787/1547] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:54.253527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:54.255740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:54.262173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.262661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.263093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.263836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.264289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.264716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.294799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5dcab06a-29be-46de-a4c6-b3d40cc7fb5c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Aug 24 15:55:54.295356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 761/1548] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:54.668707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:54.670891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:54.677459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.677947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.678384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.679183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.679534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.679987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.711926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fb293546-52d4-4128-bf13-9b68f59cae57 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047021 Aug 24 15:55:54.712431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 788/1549] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:54.782671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:54.785022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:54.791242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.791854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.792367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.793106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:54.793564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:54.793994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:54.830635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-20b97963-9137-4ff2-ab64-bf36928f6dd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051910 Aug 24 15:55:54.831211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 762/1550] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:55.195338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:55.197532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:55.203678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.204194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.204745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.205447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.205902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.206326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.236652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b616dd14-a28e-47b0-909a-add9986a4a69 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045259 Aug 24 15:55:55.237212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 789/1551] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:55.306498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:55.308698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:55.315060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.315543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.316007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.316708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.317154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.317572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.349380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-80296760-0cf8-437f-9fe6-62dbad54cc01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Aug 24 15:55:55.349855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 763/1552] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:55.723987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:55.726211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:55.733183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.733676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.734111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.734838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.735298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.735873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.764889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-16909d57-412e-4ba0-a9ba-f46b8281621a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 Aug 24 15:55:55.765446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 790/1553] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:55.842452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:55.846031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:55.852526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.853013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.853450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.854163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:55.854615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:55.855045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:55.888283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f1ca1f8a-5ed7-464e-b382-df9ec08afb89 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049727 Aug 24 15:55:55.890619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 764/1554] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:56.249257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:56.251986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:56.258107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.258624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.259052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.259777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.260224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.260643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.290852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aa8479e7-0994-426a-bd7b-28c9a5782c6f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045720 Aug 24 15:55:56.291422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 791/1555] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:56.361460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:56.363591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:56.369975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.370458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.370951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.371663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.372116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.372543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.401672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-891400b9-4261-424f-a87e-729852e5c418 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Aug 24 15:55:56.402224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 765/1556] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:56.778051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:56.780301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:56.787343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.787853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.788281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.788964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.789412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.789830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.804104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:56.820548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5c6fe86e-1c7c-44a0-b74c-cea83ad1a88f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 Aug 24 15:55:56.821099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 792/1557] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:56.901459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:56.903599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:56.910092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.910570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.911002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.911705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:56.912156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:56.912576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:56.943295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dcb524bb-b5f2-40ce-a7b3-f37b424bc4d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Aug 24 15:55:56.943944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 766/1558] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:57.303380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:57.305739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:57.311619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.312134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.312571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.313680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.314238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.314671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.346472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5222751f-5633-4f9a-95d4-bb9b5e0de947 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047254 Aug 24 15:55:57.347039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 793/1559] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:55:57.414098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:57.416301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:57.422610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.423198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.423656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.424363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.424812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.425239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.454540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f140dae4-137b-4c40-9b6e-0f685f0df2c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Aug 24 15:55:57.455162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 767/1560] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:57.833602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:57.835782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:57.841809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.842301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.842743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.843447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.844327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.845346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.876687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-39a5732b-5e41-4b3e-8c98-7edadfcd08b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046561 Aug 24 15:55:57.877271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 794/1561] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:57.954656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:57.956824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:57.962765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.963245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.963701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.964397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:57.964847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:57.965273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:57.996263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-69be9a3b-7aee-4e94-95f1-34e24d5f2005 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Aug 24 15:55:57.996821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 768/1562] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:58.358596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:58.361461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:58.367969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:58.368451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:58.368884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:58.369579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:58.370031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:58.370455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:58.399149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-25e82566-d03c-4e63-a42e-6676a0cc148f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044575 Aug 24 15:55:58.399719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 795/1563] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:58.466743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:58.469757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:58.476468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:58.476942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:58.477371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:58.478057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:58.478503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:58.478922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:58.512330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3e73a9e8-a991-4352-b025-d137381cf5d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049456 Aug 24 15:55:58.512879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 769/1564] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:58.888330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:58.890472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:58.897032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:58.897521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:58.897964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:58.898671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:58.899127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:58.899554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:58.932776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cf40769c-9903-4217-8cbc-a7e95ef901de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Aug 24 15:55:58.933375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 796/1565] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:59.008922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:59.011091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:59.018259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.018750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.019227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.019964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.020425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.020880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.045795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:59.053356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-10ead21c-327b-44f6-bb24-5c7797646432 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048401 Aug 24 15:55:59.053936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 770/1566] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:59.410655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:59.412826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:59.419351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.419866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.420298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.420991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.421445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.421867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.452337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a4428382-9aa3-4314-930c-413240b2b9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045710 Aug 24 15:55:59.452893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 797/1567] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:55:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:55:59.525691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:59.528045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:59.534598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.535083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.535519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.536240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.536695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.537118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.566886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e50ed470-0b76-40f4-b744-65ab8b5ca36a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Aug 24 15:55:59.567450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 771/1568] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:55:59.945730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:59.948044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:59.958102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.958620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.960245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.960245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:59.960450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:59.960740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:59.995900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6cc87b19-29e3-4412-94e2-06a8a5eb0787 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054339 Aug 24 15:55:59.996497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 798/1569] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:55:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:00.066155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:00.068683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:00.075260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:00.075804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:00.076252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:00.077041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:00.077513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:00.077977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:00.112835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aa36a1b7-7add-460b-9971-2c87d77c0fa2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050843 Aug 24 15:56:00.113314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 772/1570] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:00.464934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:00.467092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:00.473991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:00.474472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:00.474964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:00.475671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:00.476126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:00.476548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:00.506923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fafd8043-aba9-4955-9b27-32483b921fe6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045891 Aug 24 15:56:00.507576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 799/1571] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:00.579950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:00.581884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:00.588356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:00.588835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:00.589266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:00.589953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:00.590400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:00.590818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:00.619852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-57aefb84-1a3a-49a7-bae4-e505ee274185 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Aug 24 15:56:00.620392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 773/1572] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:01.008674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:01.010922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:01.017259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.017750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.018185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.018898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.019349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.019806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.049569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4c60c916-11a4-418b-9141-e6a776a4ef27 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Aug 24 15:56:01.050109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 800/1573] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:01.125265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:01.128571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:01.134959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.135447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.135916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.136676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.137134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.137563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.167398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-53ccc43c-613e-4aeb-8ccd-b8ff6df462f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046235 Aug 24 15:56:01.167990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 774/1574] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:01.520293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:01.522479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:01.528929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.529414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.529852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.530553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.531012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.531440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.561348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-584c833d-3a8e-4527-a3b7-1ea859e7d4a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046212 Aug 24 15:56:01.561905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 801/1575] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:01.632904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:01.635060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:01.641542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.642169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.642607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.643301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:01.643788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:01.644215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:01.673065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5d3351f2-4aa8-4c69-b9b7-3ce1b7c67e26 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Aug 24 15:56:01.673796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 775/1576] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:02.062378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:02.064840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:02.070876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.071371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.071954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.072694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.073131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.073564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.103993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9528ce32-cfaa-421e-9ef7-551209f7d954 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Aug 24 15:56:02.104469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 802/1577] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:02.179790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:02.181948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:02.188039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.188760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.189114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.189813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.190273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.190701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.220439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0bd92a8d-b39a-4a6b-a2a3-d214bc310b4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Aug 24 15:56:02.220983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 776/1578] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:02.574953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:02.577192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:02.584361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.584850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.585285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.585985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.586443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.586900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.617075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f391f9ce-c642-4f4b-9ef5-ac192c91481f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046093 Aug 24 15:56:02.617612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 803/1579] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:02.687011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:02.689817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:02.696239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.696723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.697159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.697855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:02.698311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:02.698733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:02.728317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e896f0f-abe6-4ee3-9d63-a9cfdb5b4d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Aug 24 15:56:02.728862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 777/1580] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:03.116598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:03.118711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:03.125103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.125604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.126684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.127397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.127901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.128336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.158453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ecd7e642-6fef-45de-bd7b-bedfdc16481f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Aug 24 15:56:03.159021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 804/1581] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:03.233057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:03.235824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:03.241760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.242245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.242679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.243375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.243864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.244291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.274889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-619a3c3a-f598-4826-bcbe-296b34216df5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045726 Aug 24 15:56:03.275438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 778/1582] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:03.629394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:03.631602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:03.638076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.638561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.639017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.639723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.640181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.640612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.670979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f37a2425-3c62-4793-8150-4a9301b5ab11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045497 Aug 24 15:56:03.671562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 805/1583] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:03.740869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:03.743105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:03.749507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.749985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.750422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.751118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:03.751565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:03.752016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:03.780909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-179b7ac2-1df3-42fe-8cfd-69a4947620da tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 24 15:56:03.781461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 779/1584] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:04.170909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:04.173105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:04.179592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.180120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.180554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.181253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.181707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.182131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.212557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-273f7735-13c3-4528-a68b-e0ed444fbfee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Aug 24 15:56:04.213114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 806/1585] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:04.287694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:04.289840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:04.295903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.296393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.296842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.297621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.298596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.299037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.328254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0ff86263-b81c-4b32-aea2-02294e101f4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Aug 24 15:56:04.329402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 780/1586] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:04.684823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:04.686996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:04.694305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.694791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.695245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.696027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.696484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.697290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.727882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e4e8570-22c3-42c2-b2a4-d9e67fe5f3e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047022 Aug 24 15:56:04.728440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 807/1587] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:04.794017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:04.796131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:04.803157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.803651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.804105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.804802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:04.805252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:04.805682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:04.835899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e15d57ef-e4e8-4e76-9e46-e999544063c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Aug 24 15:56:04.836461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 781/1588] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:05.226077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:05.228289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:05.234254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.234740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.236373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.237089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.237556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.237991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.268159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0fa95147-8734-4f3e-898a-379a0b0683c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046028 Aug 24 15:56:05.268746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 808/1589] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:05.342208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:05.345982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:05.352119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.352605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.353045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.353754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.354213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.354644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.384960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b8e517a6-0e2f-4ea4-bc7d-fae0ada7bb8c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047169 Aug 24 15:56:05.385447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 782/1590] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:05.740158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:05.742352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:05.748830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.749323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.749763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.750495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.751493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.751982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.754325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:05.783994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c6d17e6c-870f-4e62-9dcc-282d3f7d4c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047770 Aug 24 15:56:05.785984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 809/1591] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:05.848648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:05.850830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:05.857298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.857783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.858226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.858925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:05.859380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:05.859865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:05.889007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fd176e01-1f0e-4e72-bfcd-aa1119c9978c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Aug 24 15:56:05.889561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 783/1592] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:06.280491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:06.283343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:06.289536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.290027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.290472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.291178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.291660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.292123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.322566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a4ef7335-f535-409a-8d34-6c36be98c5ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Aug 24 15:56:06.323124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 810/1593] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:06.396760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:06.398953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:06.404861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.405340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.405776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.406465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.406913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.407903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.436848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05c3e33b-1838-4cd1-8373-d54ae1a9c332 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Aug 24 15:56:06.437415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 784/1594] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:06.797984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:06.800139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:06.806497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.806978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.807405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.808124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.808571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.808989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.839548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d2a3b11d-0909-4477-a806-5be39855966f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045513 Aug 24 15:56:06.840146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 811/1595] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:06.903261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:06.905442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:06.912975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.913461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.913923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.914607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:06.915062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:06.915491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:06.952127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-048323f7-2240-427e-b8ee-e250ced90ee6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053967 Aug 24 15:56:06.952704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 785/1596] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:07.336196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:07.338625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:07.346249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.346726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.347158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.347887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.348341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.348761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.377679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d2683f4a-599c-4a96-a5a7-a7035bb752c9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Aug 24 15:56:07.378232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 812/1597] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:07.448871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:07.451013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:07.457999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.458480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.458914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.459611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.460129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.460559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.490195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2fd20a96-2bbf-4d17-8ee0-c3dd31e8cb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Aug 24 15:56:07.490751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 786/1598] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:07.851405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:07.853588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:07.860063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.861054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.861489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.862186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.862638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.863064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.892587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b61d128e-26bc-4cdb-a733-a26cbcb3c6c4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045115 Aug 24 15:56:07.893137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 813/1599] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:07.966150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:07.968369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:07.977643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.978308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.978748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.979463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:07.979947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:07.980380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:07.995615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:08.011888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-085a3d92-539b-48a1-b8a3-13fc17da2125 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049666 Aug 24 15:56:08.012448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 787/1600] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:08.390080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:08.392396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:08.398343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:08.398833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:08.399271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:08.399998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:08.400455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:08.400882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:08.430262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ae430bed-18e2-4d74-83bc-dd96ea147b12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Aug 24 15:56:08.430818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 814/1601] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:08.503746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:08.505836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:08.511844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:08.512333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:08.512777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:08.513479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:08.513935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:08.514365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:08.543943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-38245219-b460-4920-8a50-f152170252ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Aug 24 15:56:08.544496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 788/1602] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:08.904636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:08.906782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:08.914136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:08.914612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:08.915039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:08.915762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:08.916209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:08.916628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:08.946687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-506c524e-828a-46a0-ba56-ce9e27327e61 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045959 Aug 24 15:56:08.947258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 815/1603] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:09.024297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:09.026440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:09.033438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.034008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.034445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.035142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.035590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.036038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.065759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-14a85db2-3b92-4d8d-b527-98ebb6aad3ca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Aug 24 15:56:09.066339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 789/1604] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:09.444394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:09.446532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:09.452543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.453028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.453465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.454160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.455365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.455824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.485367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4714f36f-d59b-4aba-aa15-f6de685fe991 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Aug 24 15:56:09.486023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 816/1605] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:09.557518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:09.559732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:09.566308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.566787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.567230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.567959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.568413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.568857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.598991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1f2ea401-a78a-4088-b7a2-84ab5a0792bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 Aug 24 15:56:09.599575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 790/1606] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:09.959058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:09.961218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:09.967236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.967755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.968190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:09.968918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:09.969623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:09.970047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.000730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d584da9-63a6-4822-96a9-9e967dd93671 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046135 Aug 24 15:56:10.001934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 817/1607] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:10.078198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:10.080475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:10.086792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:10.087267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:10.087726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.088414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:10.088854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:10.089276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.117827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-071174e1-ddfd-4722-977e-d09878ca88b7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Aug 24 15:56:10.118292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 791/1608] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:10.497890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:10.500100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:10.506287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:10.506768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:10.507205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.507929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:10.508386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:10.508812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.538335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6d4968f-3e39-415a-91c8-793eb60e6b96 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 24 15:56:10.538892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 818/1609] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:10.611460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:10.613671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:10.619645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:10.620153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:10.620594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.621294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:10.621746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:10.622174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:10.654642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-892175eb-662f-4cbb-9b54-ddb2796a9b12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047385 Aug 24 15:56:10.655239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 792/1610] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:11.014645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:11.016854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:11.023357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.023886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.024326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.025042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.025502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.025932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.071988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f1b81eb3-0f8c-4feb-8d58-0b46768b25dd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061506 Aug 24 15:56:11.072558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 819/1611] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:11.130122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:11.132312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:11.138719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.139204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.139666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.140368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.140821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.141243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.170271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a73321c-4eca-40da-8592-c14daab12407 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Aug 24 15:56:11.170827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 793/1612] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:11.551172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:11.553303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:11.559206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.559708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.560140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.560824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.561272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.561690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.591257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-449f5431-3d60-4b00-9b16-751f71ff0fbd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 24 15:56:11.591845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 820/1613] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:11.667421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:11.669583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:11.675715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.676203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.676645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.677343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:11.677797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:11.678220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:11.708745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ccc1c019-cfbc-4a4a-b9f8-42ca657dc685 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Aug 24 15:56:11.709330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 794/1614] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:12.084472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:12.086682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:12.093147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.093619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.094046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.095057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.095505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.096029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.125348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-909a3ebd-deba-4d22-93bf-ca415c1634df tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044756 Aug 24 15:56:12.125833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 821/1615] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:12.183187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:12.185352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:12.192726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.193209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.193641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.194341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.194794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.195217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.223436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5180d0d5-1de6-416a-be52-5daf8b7dcc25 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Aug 24 15:56:12.224010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 795/1616] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:12.604653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:12.606826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:12.613546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.614031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.614470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.615160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.615612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.616068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.645852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7db121e3-e031-4e12-9856-3f99464d12e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Aug 24 15:56:12.646742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 822/1617] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:12.722377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:12.724611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:12.730698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.731197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.731687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.732431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:12.732889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:12.733326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:12.766019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b46e2e49-09d7-4e07-8adc-446581734cf7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048750 Aug 24 15:56:12.766582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 796/1618] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:13.137815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:13.140030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:13.148929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.149824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.150628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.151919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.152691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.153188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.183789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d388e8b5-2052-4888-9b15-6a788852f074 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049947 Aug 24 15:56:13.184353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 823/1619] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:13.235671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:13.238066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:13.244440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.244917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.245344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.246032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.246475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.246888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.276762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a402532e-e8cc-461c-98ee-ee1c7f483f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Aug 24 15:56:13.277300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 797/1620] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:13.659175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:13.661348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:13.667369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.667873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.668312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.669008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.669465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.669912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.700124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-036019d9-566f-495b-95f3-0b919466c153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Aug 24 15:56:13.700683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 824/1621] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:13.779404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:13.781766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:13.787723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.788211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.788650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.789351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:13.789805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:13.790231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:13.820499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d9610989-d193-42b1-a5de-8e83a64d97c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Aug 24 15:56:13.821063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 798/1622] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:14.196131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:14.198271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:14.204682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.205167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.205597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.206292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.206746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.207183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.233072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:14.239031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ccf1d334-2163-479d-b146-de308cb8f1eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046977 Aug 24 15:56:14.239599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 825/1623] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:14.289768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:14.291911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:14.298276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.298757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.299484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.300210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.300661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.301082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.329097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9c2ddbdf-56fe-44d0-a27d-102f255dcb75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Aug 24 15:56:14.330376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 799/1624] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:14.712493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:14.714740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:14.721136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.721671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.722117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.722826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.723273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.723733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.753430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3edf931e-7aab-4481-bf48-8e90292c944b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Aug 24 15:56:14.753987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 826/1625] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:14.833647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:14.835847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:14.841881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.842396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.842810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.843515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:14.844002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:14.844427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:14.873952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2c112ab1-da3f-4ff4-8816-675e81a1bb74 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 24 15:56:14.874506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 800/1626] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:15.252078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:15.254246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:15.260641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.261122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.261554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.262248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.262700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.263123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.292806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d977ef14-103d-4491-960c-975b3bc870c6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045371 Aug 24 15:56:15.293381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 827/1627] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:15.342911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:15.345405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:15.351877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.352364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.352801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.353500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.353959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.354387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.384021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7141add6-ca03-46c2-aa5d-2375c6365726 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 24 15:56:15.384575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 801/1628] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:15.765423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:15.768021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:15.773967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.774456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.774888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.775583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.776067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.776488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.806142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf0cf634-3c3c-4363-bf41-9304aacf76aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Aug 24 15:56:15.806718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 828/1629] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:15.886633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:15.888849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:15.895271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.895787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.896223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.896916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:15.897369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:15.897794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:15.927301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-68fe3a0c-c708-4964-8f8d-c8e70b11e6c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Aug 24 15:56:15.927894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 802/1630] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:16.305933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:16.308171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:16.316301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.316794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.317233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.317946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.318405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.318834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.350600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-77175e4e-82bd-4012-b304-5be4699a8728 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048717 Aug 24 15:56:16.351412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 829/1631] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:16.395687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:16.398481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:16.404866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.405344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.405769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.406455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.406900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.407320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.435297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3ab3c2b4-f19f-4acc-9d57-d861fdf8cdb8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Aug 24 15:56:16.435872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 803/1632] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:16.819225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:16.821438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:16.827595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.828168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.828608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.829352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.829808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.830238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.859649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-573114b7-19dc-4390-a2f3-ae099e790bfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044457 Aug 24 15:56:16.860250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 830/1633] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:16.939824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:16.942006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:16.948621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.949103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.949535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.950230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:16.950679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:16.951097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:16.953528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:16.981502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e7bccee-6c3d-42bd-b33a-a79daac20e2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Aug 24 15:56:16.982051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 804/1634] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:17.364062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:17.366215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:17.372903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:17.373385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:17.373833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:17.374507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:17.374955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:17.375376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:17.405379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9165c331-d31c-4ca3-b05c-d87a35cb440e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045522 Aug 24 15:56:17.405817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 831/1635] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:56:17.447929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:17.450051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:17.457080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:17.457558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:17.457993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:17.458676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:17.459122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:17.459543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:17.488574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0fe6b89d-4c6d-4be0-b31a-168bd93f18e9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Aug 24 15:56:17.489135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 805/1636] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:17.872806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:17.874975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:17.881566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:17.882047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:17.882475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:17.883168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:17.883620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:17.884088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:17.913822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-80589279-2176-4274-bb4d-936b097eb942 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Aug 24 15:56:17.914379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 832/1637] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:17.994426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:17.996631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:18.003293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.003808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.004254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.004966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.005423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.005853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.035181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2b7f3e8-6586-4850-b42a-ed7a6fa9ecf5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Aug 24 15:56:18.035759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 806/1638] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:18.418546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:18.420711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:18.428027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.428545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.428988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.429697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.430152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.430582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.467831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-572f21d2-c688-4bd6-9d1d-17ca97372059 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053251 Aug 24 15:56:18.468390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 833/1639] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:18.500866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:18.503599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:18.510031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.510518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.510956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.511686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.512154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.512585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.542894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-46a44f2d-b932-42fa-922b-21e343dfdf34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045872 Aug 24 15:56:18.543376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 807/1640] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:18.926285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:18.928447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:18.934469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.934957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.935398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.936141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:18.936596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:18.937019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:18.967566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b2d057c-d689-4078-9dab-e2cf3d885ef0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Aug 24 15:56:18.968150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 834/1641] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:19.046612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:19.048921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:19.054842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.055326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.055808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.056507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.056961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.057394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.086579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2474aa21-2cb8-4aa4-88cf-71ac2fbd3ac6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Aug 24 15:56:19.087165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 808/1642] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:19.482894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:19.484770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:19.492087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.492672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.493123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.493834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.494358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.494970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.533027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e16547cf-84a7-4d5d-b782-4fc1e776ef83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055281 Aug 24 15:56:19.533989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 835/1643] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:56:19.558075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:19.560471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:19.567955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.568435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.568957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.569667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.570114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.570560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.610650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91fb49c0-103a-4bfe-a0f0-1d216e609b39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056556 Aug 24 15:56:19.612261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 809/1644] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:19.982015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:19.984785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:19.993035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.993527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.993958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:19.994663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:19.995111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:19.995526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.034103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c466f8cb-5479-49fb-bad0-a6d4d15f4a2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056844 Aug 24 15:56:20.034705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 836/1645] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:20.099984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:20.102026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:20.103895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:20.109195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:20.109682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:20.110116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.110891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:20.111873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:20.112296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.140556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ff789e4b-7d7e-4eb7-8923-af30799165af tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Aug 24 15:56:20.141129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 810/1646] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:20.546792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:20.549002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:20.551307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:20.556483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:20.556969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:20.557402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.558099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:20.558551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:20.558973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.588292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a2970c64-5557-4da5-af73-16a34d780238 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045530 Aug 24 15:56:20.588844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 837/1647] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:20.624474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:20.627259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:20.633189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:20.633665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:20.634101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.634793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:20.635242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:20.635692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:20.664244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91806751-37f6-4c2d-ad34-a31e03ca6c67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Aug 24 15:56:20.664786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 811/1648] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:21.046985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:21.049707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:21.055678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.056173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.056636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.057333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.057788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.058214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.088141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ed582449-1046-4949-a42e-d7cf42be554b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Aug 24 15:56:21.088699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 838/1649] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:21.153113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:21.155318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:21.161889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.162376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.162822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.163528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.164004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.164438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.193815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ebc6d328-0f9c-4c8c-90e1-301304a1326c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Aug 24 15:56:21.194366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 812/1650] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:21.600812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:21.602905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:21.610285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.611508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.612022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.612736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.613185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.613613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.643344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f4581c0f-3c55-4367-bdb6-1d3a34cced5b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046589 Aug 24 15:56:21.643960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 839/1651] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:21.676341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:21.678468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:21.684394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.684876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.685305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.685990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:21.686436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:21.686857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:21.716802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60b3440e-4650-49b9-bf25-4f7bbaddacf4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Aug 24 15:56:21.717355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 813/1652] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:22.101400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:22.103544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:22.109554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.110043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.110482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.111598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.111738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.112082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.141683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c79882ad-bddf-4e61-aaca-af6aca109b78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Aug 24 15:56:22.143046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 840/1653] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:22.206776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:22.208943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:22.215816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.216346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.216829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.217576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.218074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.218527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.247421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-384d3dde-c573-4a53-af0f-9dfb9e535832 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Aug 24 15:56:22.247997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 814/1654] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:22.655925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:22.658149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:22.664597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.665082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.665518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.666220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.666669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.667092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.698051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4ec4a907-03e6-493d-9d0b-77b4464f60d2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046252 Aug 24 15:56:22.698600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 841/1655] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:22.729784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:22.732177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:22.740051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.740548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.741166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.742016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:22.742554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:22.742995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:22.774530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-897089b0-1680-4ccc-8499-615cec37b12f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048616 Aug 24 15:56:22.775104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 815/1656] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:23.154258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:23.156453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:23.163282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.163813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.164255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.164960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.165418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.165844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.181236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:23.197479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b5c6d9f1-0ee4-4fc8-b1b0-cfa4dcf3985d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047136 Aug 24 15:56:23.198097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 842/1657] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:23.260145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:23.262277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:23.269431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.269912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.270346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.271041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.271491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.272117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.301809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e7613af6-9927-4981-9aab-ad235829c3fb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Aug 24 15:56:23.302369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 816/1658] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:23.710962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:23.713128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:23.719574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.720101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.720865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.721566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.722015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.722431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.753220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-657f6a90-e8fc-4614-bbe0-b56b165ea58d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046163 Aug 24 15:56:23.753777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 843/1659] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:56:23.786617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:23.788806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:23.794883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.795370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.795840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.796542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:23.797299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:23.797734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:23.827438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6e15a54d-770b-4fe0-9e74-c65e662142b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Aug 24 15:56:23.828035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 817/1660] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:24.210195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:24.212373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:24.218417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.218900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.219343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.220065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.221227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.221417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.250454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b5e3f94-4198-4d31-a7af-33d8b14ff0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Aug 24 15:56:24.251007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 844/1661] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:24.315018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:24.317315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:24.323788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.324278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.324715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.325416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.325876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.326305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.355715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-90fdf554-08e2-4336-8096-1d35082e9cf8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045567 Aug 24 15:56:24.356264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 818/1662] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:24.765666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:24.768717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:24.777267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.777809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.778269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.778979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.779438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.779904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.811316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7a79064c-c534-4b6c-a7b5-b1e09beb846e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049660 Aug 24 15:56:24.811925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 845/1663] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:24.840444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:24.842637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:24.850000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.850499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.850944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.851667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:24.852128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:24.852558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:24.882267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-27cd5efc-e705-46a5-a69e-29beab27b5c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Aug 24 15:56:24.882837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 819/1664] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:25.262791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:25.264955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:25.271683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.272168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.272601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.273296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.273748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.274172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.302414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4111491e-fdc9-4b2b-84f4-17b445b589d8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Aug 24 15:56:25.302965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 846/1665] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:25.367780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:25.369920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:25.377016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.377832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.378618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.379364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.379908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.380335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.405529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:25.410769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-65b15357-8b73-4982-b1e5-77faccccb038 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Aug 24 15:56:25.411328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 820/1666] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:25.824377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:25.826459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:25.833075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.833558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.833994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.834697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.835152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.835579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.865483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a78a1fd2-3fbc-42b4-9ef4-5106af1a23d8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045363 Aug 24 15:56:25.866041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 847/1667] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:25.896640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:25.898816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:25.904770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.905257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.905698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.906392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:25.906849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:25.907273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:25.939044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e1784037-283e-40e7-b7d5-c97bb561477f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Aug 24 15:56:25.940841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 821/1668] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:26.315011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:26.317218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:26.323117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.323600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.324059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.324768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.325199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.325620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.356569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-335793e4-2321-46b9-bc2b-6aa9fea86241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045953 Aug 24 15:56:26.357125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 848/1669] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:26.422576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:26.425376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:26.431830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.432319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.432761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.433471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.433925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.434355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.465569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-deb008df-5d01-4392-a75c-165d0385d4d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Aug 24 15:56:26.466161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 822/1670] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:26.878424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:26.880607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:26.887067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.887554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.888036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.888736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.889192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.889617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.919461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1e2e5d67-3277-4d48-b5a2-f8a6d7cec534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045561 Aug 24 15:56:26.920084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 849/1671] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:26.951774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:26.953968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:26.960065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.960549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.960981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.961666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:26.962115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:26.962537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:26.991621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2a2faf8a-45f8-4dc2-bf4b-82b0bf192d09 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Aug 24 15:56:26.992194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 823/1672] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:27.369325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:27.371478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:27.378139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:27.378610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:27.379370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:27.380104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:27.380568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:27.380994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:27.410248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-977b958f-f6a4-4fc2-9954-65cd6b0e1850 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 24 15:56:27.410691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 850/1673] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:27.478062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:27.480258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:27.486724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:27.487210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:27.487705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:27.488404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:27.488857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:27.489284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:27.519514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ee0158f-e718-4dc4-8ee0-291d039d3813 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Aug 24 15:56:27.520110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 824/1674] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:27.932607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:27.934795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:27.941786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:27.942277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:27.942719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:27.943430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:27.943919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:27.944344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:27.974007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-792f5a95-59ed-4989-a63a-d457bf6bac57 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045485 Aug 24 15:56:27.974585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 851/1675] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:28.004569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:28.006788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:28.012654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.013132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.013563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.014254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.014700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.015122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.043232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b1661e7a-a457-4b02-8934-1d14d9dc7e0d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Aug 24 15:56:28.043795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 825/1676] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:28.422780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:28.425634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:28.432101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.432586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.433026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.433722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.434178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.434604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.463917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-57182f1d-6d1e-4f3f-9423-1013b118f294 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Aug 24 15:56:28.464463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 852/1677] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:28.531846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:28.534051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:28.541497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.541988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.542429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.543136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.543588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.544043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.573364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-acdf8d41-e7e7-4f6a-96fb-5881291f5a2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Aug 24 15:56:28.573930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 826/1678] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:28.987166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:28.989417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:28.995448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.995973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.996412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:28.997112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:28.997567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:28.997993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.028472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-735ebc18-a8d7-4879-8785-dd3426a6e2f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045295 Aug 24 15:56:29.029028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 853/1679] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:29.054457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:29.056715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:29.062590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:29.063073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:29.063508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.064232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:29.064686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:29.065113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.094279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a91ce111-70be-4ba6-bc1d-0c6778a5fd9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Aug 24 15:56:29.094819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 827/1680] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:29.476808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:29.478947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:29.485396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:29.485875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:29.486303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.486995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:29.487443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:29.487884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.518755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f859948e-5dc0-45fa-aa64-5006226e55f9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046164 Aug 24 15:56:29.519316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 854/1681] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:29.585604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:29.587805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:29.594200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:29.594705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:29.595166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.596227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:29.596746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:29.598153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:29.628047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b2337ee3-6d99-42f6-bee5-ca0fd82d9b78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Aug 24 15:56:29.628594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 828/1682] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:30.042468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:30.044639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:30.050708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.051187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.051653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.052365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.052811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.053234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.081700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-08de4249-95e3-46d0-a98f-236766cdedfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043822 Aug 24 15:56:30.082247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 855/1683] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:30.106543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:30.108649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:30.114912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.115392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.115863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.116557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.117010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.117433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.146352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b8abe7f9-027d-4f63-9784-a3af0b96c860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043188 Aug 24 15:56:30.147182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 829/1684] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:30.531289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:30.533461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:30.540098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.540604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.541034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.541724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.542173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.542591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.571819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9faad4f3-7f6f-4384-8e38-0f02a50edfa7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Aug 24 15:56:30.572372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 856/1685] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:30.640300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:30.642492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:30.649632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.650120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.650576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.651253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:30.651734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:30.652160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:30.681740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-11b0dc93-2900-4d38-a381-5f9a0e4f26ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 24 15:56:30.682337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 830/1686] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:31.094731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:31.097217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:31.104428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.104861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.105298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.105996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.106454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.106882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.136880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f7bd2739-f957-46c2-b950-a09c624225f2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046126 Aug 24 15:56:31.137445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 857/1687] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:31.158287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:31.160492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:31.166926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.167414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.167901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.168693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.169148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.169575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.198866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78984acf-60bd-4845-8060-9b388c5a4f12 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Aug 24 15:56:31.199411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 831/1688] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:31.583896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:31.586069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:31.592432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.592919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.593357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.594079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.594535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.594961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.624843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-69c6fc28-1921-4388-b013-c216dcb6d57a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Aug 24 15:56:31.625401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 858/1689] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:31.693437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:31.695588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:31.702392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.702880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.703320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.704050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:31.704511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:31.704982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:31.735558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-060f1215-2cb8-4227-b452-9604278d5a7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Aug 24 15:56:31.736146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 832/1690] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:32.149946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:32.152166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:32.158222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.158710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.159149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.159888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.160346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.160774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.164483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:32.191073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71255a9d-7a72-4dd5-aacf-1b9e413ce478 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045706 Aug 24 15:56:32.191647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 859/1691] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:32.210886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:32.213048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:32.219044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.219520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.219985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.220937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.221419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.221844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.250941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78b5de27-1a7d-4873-94d5-3daf6c91dcc1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Aug 24 15:56:32.251489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 833/1692] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:32.636998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:32.639180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:32.645792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.646473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.646910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.647609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.648089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.648513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.679068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c8753b93-b998-4b02-8d96-e307142d79c6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 Aug 24 15:56:32.679605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 860/1693] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:32.748625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:32.750779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:32.757258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.757735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.758166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.758856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:32.759303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:32.759756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:32.789302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-55f127fa-25e4-4783-be45-bbf27e1dc130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Aug 24 15:56:32.789852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 834/1694] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:33.211173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:33.213355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:33.219296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.219822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.220254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.221194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.221643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.222065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.251050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2d804f56-75e7-4ba2-81fc-66216a41ee0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044456 Aug 24 15:56:33.251601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 861/1695] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:33.263823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:33.265955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:33.272609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.273090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.273564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.274259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.274709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.275132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.308959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b0c0e272-7f6e-4395-ae3c-80a831b60f0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048977 Aug 24 15:56:33.309550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 835/1696] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:33.690380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:33.693328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:33.699714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.700195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.700627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.701314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.701760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.702181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.731740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc15f483-4ca8-44d3-812a-ebf19f338c64 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Aug 24 15:56:33.732389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 862/1697] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:33.801564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:33.804252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:33.810711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.811192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.811649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.812446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:33.812791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:33.813209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:33.843229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e8409be7-b75c-4538-8c38-1bacd77a51f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Aug 24 15:56:33.843807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 836/1698] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:34.262619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:34.264812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:34.270719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.271201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.271658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.272354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.272809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.273236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.302811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-592ab6d2-1f2c-4209-aefe-764a78068754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044197 Aug 24 15:56:34.303368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 863/1699] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:34.321619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:34.323525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:34.329545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.330021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.330451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.331143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.331589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.332042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.345539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:34.361474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c6d5f387-674a-4f19-b222-a73b330d2d28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Aug 24 15:56:34.362031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 837/1700] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:34.744348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:34.746481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:34.752958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.753445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.753907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.754604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.755108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.755616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.785764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eecde731-ecbd-465b-9b5d-f3d563098661 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Aug 24 15:56:34.786916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 864/1701] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:34.855957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:34.858149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:34.864687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.865178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.865621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.866707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:34.867224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:34.867689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:34.900147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-84825c71-af43-4fd2-99ce-357198cf03d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Aug 24 15:56:34.900710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 838/1702] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:35.315022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:35.317188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:35.324260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.324753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.325192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.325893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.326349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.326775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.359810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eb887b4f-c7bb-4402-8b64-96d076f89ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048874 Aug 24 15:56:35.360376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 865/1703] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:35.374493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:35.376692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:35.383479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.383992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.384430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.385130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.385599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.386003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.415417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c721eb74-38ed-4863-b8e1-3f422c294943 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Aug 24 15:56:35.420075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 839/1704] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:35.798747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:35.800887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:35.807889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.808367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.808796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.809485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.809931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.810351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.839731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f00a2df-ce53-4c10-9dcd-6d335e50c111 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Aug 24 15:56:35.840284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 866/1705] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:35.913595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:35.915814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:35.922166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.922648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.923208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.923937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:35.924393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:35.924817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:35.954768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8ca55379-e7fe-4cb5-9b90-d10ab4505769 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Aug 24 15:56:35.955368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 840/1706] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:36.373114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:36.375266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:36.381656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.382141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.382578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.383267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.383745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.384167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.415317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-170eb60a-3fcd-4243-9055-4b996e823025 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046144 Aug 24 15:56:36.415919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 867/1707] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:36.427518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:36.429685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:36.435658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.436158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.436595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.437289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.437739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.438164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.467389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-07afff64-6222-4765-90c9-80e291362561 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 Aug 24 15:56:36.467979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 841/1708] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:36.853925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:36.856370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:36.864416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.865000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.865483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.866863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.867404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.867891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.910105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e0058b08-024f-488b-a6a9-cec80eb83b33 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061674 Aug 24 15:56:36.910674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 868/1709] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:36.968347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:36.970617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:36.977929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.978408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.978841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:36.979538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:36.980018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:36.980449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.009095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-36923fee-b83c-4148-bba6-66cd460c794e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 24 15:56:37.009649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 842/1710] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:37.428409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:37.430467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:37.436536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:37.437018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:37.437454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.438147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:37.438603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:37.439027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.469067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54a5a477-cd52-4293-8e29-a7debf48ed60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045266 Aug 24 15:56:37.469625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 869/1711] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:37.480396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:37.482501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:37.488461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:37.488940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:37.489984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.490705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:37.491148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:37.491571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.521269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dd3041ce-e697-47c4-b703-8063c1ea30cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 24 15:56:37.521823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 843/1712] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:37.923247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:37.925419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:37.931974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:37.932465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:37.932901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.933606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:37.934073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:37.934503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:37.967014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-adecae96-0105-4f91-a1c4-e4ad5a20edd4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047833 Aug 24 15:56:37.967571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 870/1713] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:38.022098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:38.024259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:38.030687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.031172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.031611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.032333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.032788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.033212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.062987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da6bb412-e8dc-4925-8e7e-d78655281a78 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Aug 24 15:56:38.063547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 844/1714] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:38.482501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:38.484673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:38.490791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.491274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.491739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.492438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.492942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.493352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.523339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad1372e1-3ee8-433d-b8d3-e49211438c41 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044794 Aug 24 15:56:38.523843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 871/1715] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:38.533469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:38.535604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:38.541655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.542141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.542578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.543276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.543762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.544190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.573628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-617d1509-01cd-41fd-ba4d-90ad27996311 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Aug 24 15:56:38.574179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 845/1716] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:38.979315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:38.981520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:38.987925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.988415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.988852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:38.990269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:38.990729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:38.991154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.019685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fd119291-e180-4b31-be3a-3f5d317d8dbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Aug 24 15:56:39.020235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 872/1717] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:39.075227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:39.077397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:39.083809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:39.084287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:39.084717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.085406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:39.085854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:39.086276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.115842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-24f6cdf8-4f78-4b02-bb28-cf7489928544 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 24 15:56:39.116306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 846/1718] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:39.536205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:39.539130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:39.545158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:39.545646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:39.546077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.546765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:39.547220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:39.547651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.576227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-231e1603-b022-431f-9cf4-305cf1210f97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044085 Aug 24 15:56:39.576786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 873/1719] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:39.587068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:39.589297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:39.595172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:39.595680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:39.596375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.597088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:39.597548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:39.597976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:39.629657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ec185bad-3047-4ec3-8fb7-6a8300337834 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047673 Aug 24 15:56:39.630274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 847/1720] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:40.032272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:40.034403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:40.041205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.041731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.042203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.042911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.043401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.043854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.075010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f17ceaf-d7a0-4007-8f2b-71a6090c5527 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Aug 24 15:56:40.075604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 874/1721] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:40.128035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:40.130163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:40.137835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.138322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.138762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.139468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.139958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.140389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.172291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-626997e6-9339-4016-92b5-ec58835b9c8e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 Aug 24 15:56:40.172914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 848/1722] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:40.588770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:40.590945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:40.597100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.597592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.598004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.598686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.599136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.599558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.624903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:40.630515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cc5bb792-9a3f-49db-9c43-63c8e7e46be4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045743 Aug 24 15:56:40.631073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 875/1723] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:40.641955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:40.644198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:40.650311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.650800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.651232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.651993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:40.652447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:40.652871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:40.683734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c35ac4cd-4359-4858-8add-ee5607807028 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Aug 24 15:56:40.684306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 849/1724] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:41.088237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:41.090391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:41.097006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.097535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.097916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.098604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.099073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.099490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.129078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6e818ab4-183d-4bc1-944c-544d3155736d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Aug 24 15:56:41.129622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 876/1725] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:41.186032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:41.188189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:41.195832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.196311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.196746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.197568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.198017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.198435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.228734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4bf5a686-9500-4e80-b69e-e89547ce251f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Aug 24 15:56:41.229300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 850/1726] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:41.642430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:41.644720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:41.651010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.651502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.651969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.652673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.653132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.653564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.683709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-764559bc-0b20-4dfa-94a4-e441e119b743 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045258 Aug 24 15:56:41.684266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 877/1727] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:41.697021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:41.699224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:41.705228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.705697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.706135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.706831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:41.707285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:41.707737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:41.735832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-84e4ab31-5417-472e-afd1-f090ce9a9c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Aug 24 15:56:41.736321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 851/1728] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:42.140580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:42.142707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:42.149329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.149812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.150243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.150937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.151386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.151840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.181852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90ccb9ae-fb61-420a-b838-226f101012eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Aug 24 15:56:42.182419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 878/1729] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:42.243070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:42.245269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:42.253202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.253689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.254157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.254873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.255331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.255786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.287152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-431deb22-eead-45b9-8d0c-25eb4d105c10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049890 Aug 24 15:56:42.287736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 852/1730] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:42.696255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:42.698395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:42.704382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.704862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.705296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.705992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.706447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.706872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.737625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f3e02ec-8925-4cc9-a11d-48db898ef6cc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046086 Aug 24 15:56:42.738185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 879/1731] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:42.747717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:42.749899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:42.755789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.756272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.756704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.757944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:42.758391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:42.758812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:42.787357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bdf88d2d-aa5f-4550-ac31-5491113dcde3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Aug 24 15:56:42.787944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 853/1732] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:43.194427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:43.197098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:43.203400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.203921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.204358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.205047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.205495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.205940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.234532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8057d26e-14ec-4180-a851-d0bda887b5ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Aug 24 15:56:43.235083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 880/1733] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:43.299669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:43.301842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:43.310310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.310803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.311248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.311977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.312437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.312866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.315235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:43.343160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-11dd15fc-787b-4630-b32e-ce6d398e7a46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Aug 24 15:56:43.343740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 854/1734] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:43.749944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:43.752118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:43.758193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.758675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.759113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.759876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.760338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.760769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.790635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-77205c88-d447-4ab2-8eba-8e6456392674 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044716 Aug 24 15:56:43.791128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 881/1735] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:43.799455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:43.801638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:43.808241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.808727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.809160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.809851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:43.810303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:43.810727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:43.839949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a0b85699-9c27-43a3-8ead-b937ce8dd0c9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Aug 24 15:56:43.840504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 855/1736] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:44.246813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:44.249088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:44.255524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.256044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.256477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.257669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.258120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.258540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.294797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-15213253-eb33-44c9-b9a6-931c579713d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051777 Aug 24 15:56:44.295786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 882/1737] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:44.356012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:44.358136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:44.364524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.365015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.365453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.366150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.366961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.367107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.396502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e175c7f8-7fad-4ecf-b437-9bdbb83f972e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Aug 24 15:56:44.397052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 856/1738] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:44.802883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:44.805617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:44.811625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.812140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.812577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.813303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.813760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.814213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.844671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-33566e46-09c9-44b5-8f76-908d3dd3a668 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Aug 24 15:56:44.845426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 883/1739] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:44.853371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:44.855502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:44.861437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.861915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.862349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.863083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:44.863713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:44.864139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:44.893798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aded4f71-e1c2-4ec8-99ae-5c503032c64c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Aug 24 15:56:44.894349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 857/1740] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:45.308101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:45.310254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:45.316776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.317258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.317692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.318391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.318848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.319277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.351382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e5899c5-56e8-4ebe-ac8a-bd725f54a60d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047079 Aug 24 15:56:45.352226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 884/1741] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:45.409608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:45.411701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:45.418983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.419469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.419937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.420630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.421076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.421495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.449764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-94dfb17a-e34e-4bf5-80e6-1f329917c981 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Aug 24 15:56:45.450505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 858/1742] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:45.857453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:45.859577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:45.865598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.866083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.866521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.867223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.867701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.868132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.898570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-31589c87-b6e2-44e3-a1bf-559486053f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044421 Aug 24 15:56:45.899146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 885/1743] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:45.906370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:45.908677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:45.914692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.915178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.915621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.916337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:45.916793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:45.917225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:45.946298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6f1cb9ad-6c07-4029-9b53-b0db1f083cec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Aug 24 15:56:45.946875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 859/1744] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:46.364262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:46.367029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:46.373526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.374049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.374489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.375201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.375686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.376125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.407398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-272b6e22-5ee4-42c7-94ae-906d8112238a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047172 Aug 24 15:56:46.407989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 886/1745] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:46.461767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:46.463971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:46.466305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:46.471394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.472175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.472613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.473306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.473761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.474187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.504058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-52da13cd-dbf3-4d7c-9a95-8abc9345a246 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046526 Aug 24 15:56:46.504608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 860/1746] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:46.910254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:46.912438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:46.915549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:46.921071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.921557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.921992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.922694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.923147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.923568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.953134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f7fa58a4-4d64-4a01-99d9-08f9f643bd45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046890 Aug 24 15:56:46.953694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 887/1747] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:46.958752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:46.961654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:46.967599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.968111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.968601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:46.969693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:46.970173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:46.970604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:47.000343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-82f8f217-8f4a-462a-98a7-23c216599a81 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Aug 24 15:56:47.000918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 861/1748] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:47.420013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:47.422065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:47.428410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:47.428911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:47.429418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:47.430105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:47.430554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:47.430975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:47.459758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-37270876-4e3a-4257-9dcc-ee662c5ad6eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Aug 24 15:56:47.460952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 888/1749] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:47.516716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:47.518853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:47.526059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:47.526543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:47.526984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:47.527714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:47.528179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:47.528607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:47.558906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1099af54-b06b-4d29-b7b5-52a08570d5c0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Aug 24 15:56:47.559460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 862/1750] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:47.964885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:47.967011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:47.973265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:47.973750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:47.974186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:47.974879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:47.975334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:47.976277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.009207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5cb84a60-11d0-488c-93bb-56d3eada674c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048445 Aug 24 15:56:48.009767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 889/1751] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:48.013161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:48.015535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:48.021422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:48.021908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:48.022347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.023224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:48.023751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:48.024183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.053185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6ecdcddb-ec0b-4daf-8db0-d9f7c7649764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Aug 24 15:56:48.053746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 863/1752] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:48.473003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:48.475168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:48.482608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:48.483098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:48.483540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.484331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:48.484799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:48.485234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.516985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-27223c27-124f-49f2-ad87-55b37fb8ee43 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048264 Aug 24 15:56:48.517544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 890/1753] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:48.570764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:48.572914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:48.579286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:48.579806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:48.580238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.580924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:48.581373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:48.581791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:48.612552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e5266791-1dd8-464e-b058-8d9b5aeb122e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045744 Aug 24 15:56:48.613101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 864/1754] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:49.022473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:49.024756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:49.033930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.034806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.035567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.036453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.037109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.037902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.067572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:49.070399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:49.071547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c1144994-4dca-4348-a995-a9cca3c8d2f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053926 Aug 24 15:56:49.072167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 891/1755] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:49.076780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.077265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.077700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.078407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.078859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.079308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.107982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c45bf0f6-cc0e-43ba-9749-94954c30ed3f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 24 15:56:49.108468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 865/1756] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:49.529672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:49.531518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:49.537898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.538878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.539315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.540041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.540495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.540923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.555144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:49.571437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a432ffa-5329-49b1-b7c1-1d7cdee8af8b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045997 Aug 24 15:56:49.572044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 892/1757] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:49.624826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:49.627018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:49.633442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.633923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.634359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.635036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:49.635487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:49.635942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:49.665864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc194e77-f518-41a7-9580-966e010002e9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Aug 24 15:56:49.666419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 866/1758] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:50.084788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:50.087597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:50.093616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.094107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.094560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.095245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.095730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.096166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.120776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:50.122879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:50.127051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8e2cb8a9-be46-409f-8270-5680bf4f15db tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046255 Aug 24 15:56:50.127622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 893/1759] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:50.128962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.129453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.129892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.130596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.131049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.131476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.161117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c8200bd5-cbeb-4acd-8311-d90fa73032d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Aug 24 15:56:50.161669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 867/1760] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:50.584020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:50.586649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:50.593114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.593597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.594027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.594719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.595169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.595592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.625860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-edfb9ccb-c7a5-4327-8e19-00d1ce9f7780 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Aug 24 15:56:50.626431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 894/1761] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:50.678016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:50.680735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:50.686785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.687270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.687742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.688443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:50.688895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:50.689317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:50.718526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-624be1a8-a4f1-4300-91bc-a7d0e8603ba5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Aug 24 15:56:50.719081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 868/1762] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:51.139549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:51.141694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:51.147793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.148277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.148745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.149432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.149884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.150301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.175090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:51.177386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:51.181234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-609ff2b3-4d06-45c5-81e3-5895246050e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045653 Aug 24 15:56:51.181807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 895/1763] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:51.184548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.185031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.185802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.186170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.186620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.187042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.215830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-914aab89-c4c6-4c83-a08d-0dd5fc80831b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Aug 24 15:56:51.216383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 869/1764] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:51.638232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:51.641296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:51.651520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.652041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.652673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.653829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.654578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.655264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.689607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb8c09aa-c055-4a87-84c3-8a737ee186d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055285 Aug 24 15:56:51.690162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 896/1765] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:51.730701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:51.732868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:51.738910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.739392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.739872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.740570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:51.741023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:51.741450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:51.766120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:51.771328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2ae1cbcd-527b-400b-8e21-7c36f30e22da tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 24 15:56:51.771916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 870/1766] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:52.193654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:52.196493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:52.202497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.202983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.203422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.204148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.204607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.205034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.228831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:52.230999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:52.236309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f4bc31e-0804-4915-8922-392ed0d1cf1a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046504 Aug 24 15:56:52.237054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 897/1767] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:52.237344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.237828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.238276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.238964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.239415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.239864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.270915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4270bf96-3970-412f-8868-4e63b6d571f3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046282 Aug 24 15:56:52.271492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 871/1768] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:52.702409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:52.704604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:52.711007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.711490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.711973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.712668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.713122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.713543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.743839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa250c1c-65da-45cb-baca-1219bc89008a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Aug 24 15:56:52.744397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 898/1769] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:52.784849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:52.787004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:52.793532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.794006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.794435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.795119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:52.795565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:52.796012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:52.825696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e5677cdd-502e-4146-a816-083e45a657ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Aug 24 15:56:52.826276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 872/1770] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:53.248840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:53.250954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:53.256960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.257976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.258413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.259106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.259556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.260028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.283537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:53.285717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:53.290034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f6a097fa-20df-45fd-a748-b82777774538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045163 Aug 24 15:56:53.290596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 899/1771] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:53.292329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.292815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.293628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.294333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.294786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.295210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.324377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e824184c-789d-4392-a567-abc79f2bc4cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Aug 24 15:56:53.324936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 873/1772] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:53.756242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:53.759983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:53.766677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.767191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.767658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.768399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.768859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.769320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.800551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f856a125-7c0f-4a16-b382-89bc0fe1dbab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Aug 24 15:56:53.801117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 900/1773] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:53.838292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:53.841059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:53.848076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.848076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.848540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.849243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:53.849699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:53.850126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:53.879557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fe1425e1-0282-4124-8182-d10bf05619be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Aug 24 15:56:53.880146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 874/1774] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:54.302329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:54.305237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:54.311296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.311891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.312290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.312993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.313455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.313933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.337371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:54.339624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:54.345980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.346191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2b3e2d30-fe93-460c-88c4-07a05adf5ba3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047749 Aug 24 15:56:54.346469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.346820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 901/1775] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:56:54.346939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.347885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.348343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.348767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.377891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9bf66fb-cb45-4d37-8c37-1f0acca14d70 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Aug 24 15:56:54.378440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 875/1776] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:54.813826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:54.816038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:54.823153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.823652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.824110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.824816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.825271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.825695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.857664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-af844eb7-0c34-4943-b50e-8b8e87b7b9fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047801 Aug 24 15:56:54.858229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 902/1777] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:54.892649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:54.894838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:54.902273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.902764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.903205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.903952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:54.904409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:54.904837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:54.934844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-23abf9d2-30cc-4650-9c20-c15998aef454 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046067 Aug 24 15:56:54.935419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 876/1778] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:55.358964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:55.361270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:55.368907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.369411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.369850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.370573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.371114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.371485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.390211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:55.392859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:55.400446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.401218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.401954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.402835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.403464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.404242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.404386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71354b0f-0f5b-44be-a17e-ad4ad7ba4a83 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049503 Aug 24 15:56:55.404970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 903/1779] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:55.439606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-26746201-a025-4fee-8733-9e16f3ed0e84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052902 Aug 24 15:56:55.440615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 877/1780] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:55.870650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:55.872860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:55.879654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.880181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.880592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.881495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.881996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.882582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.912443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4b856cd-0ab3-4365-9f01-01bc95b990d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Aug 24 15:56:55.913007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 904/1781] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:55.947513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:55.949704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:55.955700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.956182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.956614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.957302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:55.957773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:55.958215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:55.988446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4759aeaf-1ec0-4b05-8425-16d26243a1dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Aug 24 15:56:55.989000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 878/1782] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:56.417291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:56.419517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:56.425551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:56.426035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:56.426469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:56.427167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:56.427623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:56.428070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:56.453307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:56.455558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:56.457850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7f429f9-49d9-435e-adf9-538782565219 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044851 Aug 24 15:56:56.458410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 905/1783] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:56.462819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:56.463383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:56.463923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:56.464636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:56.465092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:56.465551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:56.494565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f37efd13-060e-4938-a9b2-d88fe6e9902f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 24 15:56:56.495121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 879/1784] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:56.925181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:56.927291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:56.934336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:56.934817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:56.935246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:56.935988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:56.936427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:56.936849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:56.967884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d8b09167-f39b-450c-9b07-09dda48cade6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Aug 24 15:56:56.968446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 906/1785] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:57.000672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:57.002868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:57.009405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.009893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.010334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.011051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.011529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.011973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.049462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a95cbb5-0b68-43e9-a547-a2fbffd7dfa0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052685 Aug 24 15:56:57.050036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 880/1786] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:57.472635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:57.474717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:57.481972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.482455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.482898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.483623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.484109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.484538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.507890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:57.510038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:57.516365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.516842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.517304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.518007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.518123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-96fee129-9014-4107-972d-b27532762a35 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049860 Aug 24 15:56:57.518456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.518569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 907/1787] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:56:57.522496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.549081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d284ac58-3a9c-4ca5-8be8-2c47ce6a6980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045494 Aug 24 15:56:57.549644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 881/1788] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:57.981083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:57.983300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:57.989983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.990477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.990915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:57.991670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:57.992808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:57.993245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.024342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6a19dbd9-954c-449d-99ca-de00c0224e53 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Aug 24 15:56:58.024908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 908/1789] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:58.136074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:58.138212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:58.144126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:58.144607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:58.145044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.145774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:58.146228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:58.146652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.176700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a01b0f6b-27f5-4f92-a388-1cd66d53ad31 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118419 Aug 24 15:56:58.177263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 882/1790] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:58.530746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:58.532978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:58.540251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:58.540737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:58.541176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.541874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:58.542332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:58.542758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.546643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:58.562028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:58.564472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:58.571002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:58.571485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:58.571948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.572648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:58.573107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:58.573521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:58.575307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b4bce324-25c8-476f-b78d-498d0147ff4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048653 Aug 24 15:56:58.575942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 909/1791] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:58.602646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0843fdd2-d0b9-4c42-b947-47e8aee414cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044706 Aug 24 15:56:58.603490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 883/1792] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:59.036668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:59.039521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:59.045951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.046447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.046889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.047605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.048091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.048521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.079440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-40463201-7ccc-42ea-9a1d-5a42eb791f67 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046596 Aug 24 15:56:59.079947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 910/1793] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:56:59.189579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:59.191775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:59.198693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.199183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.199622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.200351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.200808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.201239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.232625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-98137ee3-7611-423f-bedc-c8fb09f604f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 Aug 24 15:56:59.233197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 884/1794] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:56:59.587694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:59.589895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:59.596404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.596890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.597326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.598287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.598742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.599170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.614941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:56:59.617762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:56:59.624255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.624748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.625190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.625897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:56:59.626355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:56:59.626778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:56:59.631104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4fbc4233-8287-404e-a4e6-3c7243866459 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047510 Aug 24 15:56:59.631711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 911/1795] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:56:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:56:59.659350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c8017263-5ef7-4514-8107-e739ad395450 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048651 Aug 24 15:56:59.659964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 885/1796] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:56:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:00.092670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:00.094896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:00.102946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.103367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.103845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.104588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.105054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.105489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.140055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3ea2964c-5c5a-4551-948c-29c7f7b87430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051358 Aug 24 15:57:00.140658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 912/1797] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:00.246212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:00.248388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:00.254455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.254938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.255381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.256110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.256567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.256996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.289149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c857c616-a181-47c0-b817-eea65c2879b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Aug 24 15:57:00.293390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 886/1798] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:00.644481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:00.646691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:00.656171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.656656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.657137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.657818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.658257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.658680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.671925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:00.674109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:00.681275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.681774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.682216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.682933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:00.683393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:00.683860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:00.690215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8bb01513-4a8c-4680-8c02-073310fa95a1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049678 Aug 24 15:57:00.690798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 913/1799] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:00.698841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:00.716615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d4553df8-38ab-4b01-9061-d37239c3397d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048678 Aug 24 15:57:00.721989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 887/1800] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:01.152344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:01.154532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:01.160680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.161170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.161615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.162314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.162810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.164008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.201740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-68046571-25d7-4962-bba7-0265827257f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053523 Aug 24 15:57:01.202335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 914/1801] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:01.307804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:01.309966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:01.315908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.316394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.316833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.317531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.317989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.318433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.350737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9c3e0b9f-26fb-4393-bd2e-83de1c925e96 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Aug 24 15:57:01.351446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 888/1802] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:01.702784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:01.704936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:01.711277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.711774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.712209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.712925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.713379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.714112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.730009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:01.732203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:01.738521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.739001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.739431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.740171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:01.740619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:01.741041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:01.745412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8fa777ce-2355-4918-95ef-93fc988be6ad tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046832 Aug 24 15:57:01.746361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 915/1803] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:01.771071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2a01068e-092a-4394-af1f-491cdf58e044 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Aug 24 15:57:01.771986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 889/1804] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:02.215658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:02.217819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:02.224048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.224536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.224971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.225777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.226241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.227328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.256664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-afe37ca7-e939-470a-9452-e4bdb3a63673 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Aug 24 15:57:02.257228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 916/1805] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:02.362458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:02.364614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:02.370543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.371038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.371485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.372208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.372657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.373080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.403831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b4a61a7-2815-4731-845b-112027c8b5cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Aug 24 15:57:02.404394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 890/1806] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:02.758386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:02.760736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:02.767196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.767706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.768214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.768843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.769299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.769725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.782348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:02.784503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:02.791097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.791580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.792051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.792753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:02.793204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:02.793632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:02.799770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-00b0dad6-dae6-4926-8148-4bcb929fa9e4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045969 Aug 24 15:57:02.800337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 917/1807] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:02.823708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7a09fabf-7d8b-4dc6-a0d5-e920a95c817d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Aug 24 15:57:02.824478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 891/1808] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:03.270014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:03.272210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:03.278626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.279090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.279526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.280252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.280706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.281136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.311160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a64184c-41a1-40be-8047-bb0c717a13c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Aug 24 15:57:03.311740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 918/1809] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:03.416935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:03.418186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:57:03.418332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 15:57:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:57:03.418987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:03.425366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.425845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.426277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.426977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.427425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.427874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.456596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e5744692-4829-4051-87bd-eefc46602c8b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Aug 24 15:57:03.457145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 892/1810] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:03.837385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:03.839831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:03.846655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.847221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.848230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.848852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.849315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.849747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.878848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:03.881015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:03.886409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-68d07baf-a69a-4144-9c9b-436a6c07c445 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054380 Aug 24 15:57:03.887001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 893/1811] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:03.887898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.888437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.888875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.889582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:03.890037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:03.890464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:03.922797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-567701ec-2ebf-42be-a6c5-906ae42202aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115095 Aug 24 15:57:03.923468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 919/1812] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:04.323413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:04.325593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:04.331465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.331995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.332436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.333125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.333574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.333995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.362966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ed05d97d-7aec-49f9-8605-202101174107 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044207 Aug 24 15:57:04.363513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 894/1813] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:04.469102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:04.471232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:04.478183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.478670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.479109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.479855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.480315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.480747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.516702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-99ede451-d51d-40d3-940a-02d7b2775438 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051530 Aug 24 15:57:04.517284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 920/1814] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:04.899489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:04.901730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:04.908218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.908709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.909250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.909845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.910303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.910733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.934948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:04.937157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:04.942898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-93e92476-43fa-4a51-b624-ceaf1289bcc5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048291 Aug 24 15:57:04.945230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 895/1815] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:04.946046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.946046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.946046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.946046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:04.946363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:04.946462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:04.978768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-621a514d-7f3c-4073-bf83-9a19cbeb7537 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048367 Aug 24 15:57:04.979337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 921/1816] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:57:05.375524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:05.377671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:05.384225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:05.384709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:05.385133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:05.385819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:05.386261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:05.386677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:05.416371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d9d6194-6ae9-4140-ab74-916982d43357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Aug 24 15:57:05.416842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 896/1817] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:05.529582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:05.531779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:05.537679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:05.538154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:05.538588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:05.539610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:05.540089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:05.540523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:05.569489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10edae17-5887-4773-b2b9-1b312c77087e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Aug 24 15:57:05.570076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 922/1818] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:05.954488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:05.956711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:05.963290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:05.963815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:05.964256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:05.964948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:05.965398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:05.965818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:05.991055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:05.994499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:05.998478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7aa22500-7d9a-49a6-a080-183e32294f4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Aug 24 15:57:05.999320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 897/1819] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:06.002573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:06.003069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:06.003508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:06.004243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:06.004705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:06.005131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:06.038081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-58907c08-4d97-4ab6-84ac-fb64f81ac6a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050932 Aug 24 15:57:06.038657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 923/1820] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:06.428068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:06.430194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:06.436117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:06.436594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:06.437027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:06.437715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:06.438157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:06.438575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:06.468697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f711afe5-860d-4831-9d2e-9c625c0b5a9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Aug 24 15:57:06.469502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 898/1821] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:06.582337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:06.584553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:06.592759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:06.593253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:06.593694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:06.594396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:06.594856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:06.595284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:06.626723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6de618c1-840b-4123-a00c-e828db054db4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048308 Aug 24 15:57:06.627278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 924/1822] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:07.011204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:07.013265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:07.019700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.020188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.020625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.021321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.021773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.022209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.052252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:07.053271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-41572f58-61fa-42e3-8309-2a399f59469c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Aug 24 15:57:07.054007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 899/1823] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:07.056434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:07.063644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.064174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.064617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.065327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.065787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.066216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.093071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:07.098561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f989735c-45e0-46ff-a15e-acb20080a2ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051753 Aug 24 15:57:07.099127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 925/1824] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:57:07.483645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:07.485797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:07.491612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.492768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.493324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.494016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.494473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.494886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.530819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d430e988-41cd-4b11-86f6-3ae248def35e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050894 Aug 24 15:57:07.531402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 900/1825] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:07.639196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:07.641538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:07.647848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.648598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.649133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.649838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:07.650294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:07.650723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:07.680789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0b5c6e87-16ed-42ca-98ce-696b483920c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Aug 24 15:57:07.681352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 926/1826] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:08.065470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:08.067582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:08.074218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.074776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.075210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.075925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.076376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.076795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.111114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d029c66f-ae92-4fb5-aa53-66225efa0679 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049493 Aug 24 15:57:08.111574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:08.112415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 901/1827] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:08.113814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:08.120987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.121491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.121930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.122647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.123101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.123529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.155549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-215fdb4c-9bab-4df7-a6e5-bf6024a8f538 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048043 Aug 24 15:57:08.156165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 927/1828] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:08.543452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:08.545645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:08.551528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.552044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.552475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.553156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.553602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.554020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.583719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0ffaf725-7e90-48d9-a91a-cb4d28a444cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Aug 24 15:57:08.584273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 902/1829] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:08.692983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:08.696421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:08.702354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.702843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.703279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.704005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:08.704462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:08.704886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:08.733938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-510ad2a3-b9f6-4a4a-a817-010d67ef4027 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Aug 24 15:57:08.734495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 928/1830] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:09.124113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:09.126154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:09.132463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.132938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.133372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.134048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.134492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.134996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.165837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3a7ddb80-23b3-40b7-868f-2114c0516ce1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Aug 24 15:57:09.166601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 903/1831] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:09.169185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:09.172311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:09.178849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.179334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.180685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.181185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.181638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.182061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.211620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-37cd5ac1-6a13-4e6e-8c1b-be01beafec3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047740 Aug 24 15:57:09.212196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 929/1832] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:09.596054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:09.598457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:09.605185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.605672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.606108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.606824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.607278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.607722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.611462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:09.639944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-96cc7247-3417-4493-a5d1-2dfa84b9d519 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047814 Aug 24 15:57:09.640511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 904/1833] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:09.746510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:09.748730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:09.754601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.755094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.755529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.756255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:09.756712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:09.757156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:09.787755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-803999ba-bdfe-4de4-812c-6b580f7a5992 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Aug 24 15:57:09.788329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 930/1834] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:10.178956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:10.181651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:10.188084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.188571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.189008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.189705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.190163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.190588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.220632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6a7f312a-07ff-4335-b7a6-f60fe9b8015e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045816 Aug 24 15:57:10.221380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 905/1835] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:10.227867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:10.230018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:10.236452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.236945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.237385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.238088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.238542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.238965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.271087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dafdabbf-673e-4809-9619-5a3e78dc09ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051131 Aug 24 15:57:10.271655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 931/1836] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:57:10.652513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:10.654652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:10.660639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.661116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.661548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.662236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.662682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.663106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.692888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f087b5ac-2e4d-4da1-af72-12a6df8694f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 24 15:57:10.693441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 906/1837] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:10.800063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:10.802191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:10.808892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.809376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.809817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.810517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:10.810970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:10.811390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:10.842214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d944d7b5-a060-46dc-9969-6283bb95356e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Aug 24 15:57:10.842842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 932/1838] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:11.233341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:11.235470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:11.241847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.242325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.242759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.243453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.243932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.244352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.274344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58fe6540-d013-4fa1-83a3-f2e68f16875b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Aug 24 15:57:11.274654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 907/1839] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:11.283990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:11.286155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:11.292800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.293316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.293796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.294509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.294965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.295413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.330060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6925c20-61dd-46dc-be09-2784249db286 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050091 Aug 24 15:57:11.330614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 933/1840] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:11.705245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:11.707390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:11.713757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.714243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.714679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.715374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.715864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.716296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.745705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-498ab61e-b449-4cdf-8304-e300fe92b967 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Aug 24 15:57:11.746257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 908/1841] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:11.854949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:11.857170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:11.863036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.863521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.863996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.864691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:11.865143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:11.865565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:11.895258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf94b909-88c2-4a5a-b9bb-3460de1f5a9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Aug 24 15:57:11.895820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 934/1842] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:12.286281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:12.288464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:12.295725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.296207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.296638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.297328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.297771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.298194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.328492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-46b7bd70-4820-4d4c-ae44-15d59eec19b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Aug 24 15:57:12.329129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 909/1843] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:12.344190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:12.346341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:12.354040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.354561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.355055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.355818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.356275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.356703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.387913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e22f6be8-3c5d-48df-929a-cf878b4b2140 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047879 Aug 24 15:57:12.388489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 935/1844] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:12.758670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:12.760980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:12.762874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:12.768062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.768598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.769094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.769727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.770180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.770597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.800046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ed546190-c9c6-41b6-82dd-3c7a03e160ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Aug 24 15:57:12.800624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 910/1845] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:12.907910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:12.910038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:12.916608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.917100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.917536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.918241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.918696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.919121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.951234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a2ac41e-1321-48f0-91f3-b70d3d0824d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 Aug 24 15:57:12.951832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 936/1846] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:13.341616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:13.343946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:13.350122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.350599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.351031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.352217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.353308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.353308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.381967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-51dac213-7529-4b3d-83a9-f8137da96501 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Aug 24 15:57:13.382607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 911/1847] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:13.401005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:13.403146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:13.405634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:13.418370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.418938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.419470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.420341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.420957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.421395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.452149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eaf9099e-9ec2-497b-bf73-db2e20509166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055980 Aug 24 15:57:13.452706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 937/1848] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:13.812382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:13.814569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:13.820605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.821312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.821762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.822495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.822948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.823369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.855309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b89368c3-1e69-4400-b8e0-baea394c299f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Aug 24 15:57:13.855921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 912/1849] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:13.964481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:13.966623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:13.972625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.973108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.973795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.974485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.974940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.975364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.005527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3b93e5c6-9f22-4890-aa87-2295c6f0f11a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Aug 24 15:57:14.006006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 938/1850] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:14.394842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:14.397119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:14.405105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.405592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.406030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.406729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.407180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.407603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.437289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ea5abe1f-2c30-45d1-9db0-2fceb8db8050 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Aug 24 15:57:14.441638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 913/1851] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:14.465767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:14.468032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:14.474450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.474940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.475373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.476085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.476563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.476987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.511479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-317929bb-18fc-4dfd-a874-ee49f5e25427 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050591 Aug 24 15:57:14.512055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 939/1852] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:14.866963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:14.869625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:14.875959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.876437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.876865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.877552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.877997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.878416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.907453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6c902e6f-6735-4b50-bffd-94ead09f63fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Aug 24 15:57:14.908058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 914/1853] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:15.018143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:15.020359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:15.026382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.026870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.027823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.028031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.028488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.028908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.058765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0e86a67e-d1c4-4867-8c0b-2da6ff090eba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Aug 24 15:57:15.059323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 940/1854] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:15.450457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:15.452526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:15.458835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.459308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.459784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.460467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.460973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.461417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.491409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dce80d54-b099-4cec-bd94-fc630e5aa5de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Aug 24 15:57:15.491999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 915/1855] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:15.524985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:15.527294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:15.533765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.534256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.534691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.535392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.535872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.536300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.565692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aeabf04a-e398-4966-abca-3cff1b807042 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044598 Aug 24 15:57:15.566250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 941/1856] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:15.920432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:15.922590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:15.928549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.929036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.929471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.930791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.931242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.931756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.961965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-baa4c821-9d2e-4102-81ec-75cbb0525921 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Aug 24 15:57:15.962520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 916/1857] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:16.070971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:16.073157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:16.079021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.079497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.079973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.080661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.081112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.081531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.095960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:16.112843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5166c4d4-040b-4d70-8bdb-0226c0a9844a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Aug 24 15:57:16.113312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 942/1858] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:16.504395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:16.506589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:16.513541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.514024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.514454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.515144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.515596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.516047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.546252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cdc20a73-1615-4fb7-8a44-436f4409ef01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Aug 24 15:57:16.546762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 917/1859] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:16.577975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:16.580209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:16.587994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.588487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.588931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.589642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.590101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.590559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.623299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ba089c90-8eae-4971-bada-2fb5adde40f0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049200 Aug 24 15:57:16.623882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 943/1860] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:16.974128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:16.976319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:16.982524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.983007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.983471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:16.984196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:16.984659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:16.985082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.015115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-65a471e2-2352-4127-96ce-95f4b5fa82b4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045236 Aug 24 15:57:17.015684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 918/1861] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:17.125188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:17.128038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:17.135234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.135757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.136203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.136912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.137407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.137839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.167306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a74bf843-aef1-4c4c-825f-16342fe317b6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 24 15:57:17.167896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 944/1862] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:17.559376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:17.561552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:17.567968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.568455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.568908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.569601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.570051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.570589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.600874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91c2a49d-2da8-44e3-b358-038c9aa739b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 Aug 24 15:57:17.601444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 919/1863] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:17.635559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:17.637717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:17.644295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.644853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.645362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.646188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.646712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.647205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.678687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-86a1596a-f546-4fde-8529-78af6fac106c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047060 Aug 24 15:57:17.679249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 945/1864] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:18.028484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:18.030804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:18.036715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.037195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.037622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.038314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.038761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.039259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.063302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:18.068294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f0971461-88c7-4e82-be88-ce74de536fac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 24 15:57:18.068842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 920/1865] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:18.181812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:18.183961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:18.189882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.190370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.190793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.191482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.191952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.192373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.222170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6cd3d093-d85d-4854-9b2c-2239ffabd18a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Aug 24 15:57:18.222741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 946/1866] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:18.614062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:18.616161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:18.622662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.623150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.623581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.624311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.624764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.625190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.655500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-79beee22-5928-4641-865a-5f95f0cdc494 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Aug 24 15:57:18.656281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 921/1867] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:18.690496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:18.692675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:18.700836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.701335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.701774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.702487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.702946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.703375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.734421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7eb56f1d-188d-45f3-9b8d-79141767ae28 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047880 Aug 24 15:57:18.734987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 947/1868] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:19.081742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:19.083942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:19.090196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.090668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.091095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.091813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.092263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.092694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.121836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e5343113-5be8-4de6-a643-93342422f87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Aug 24 15:57:19.122383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 922/1869] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:19.234698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:19.236889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:19.243995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.244487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.244929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.245634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.246094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.246523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.277258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1e118d4f-f42d-4cd1-8594-a68734361df2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046543 Aug 24 15:57:19.277831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 948/1870] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:19.669152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:19.671294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:19.677812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.678292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.678728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.679423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.681152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.681586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.711500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb5b9d88-b171-4f8b-9f30-1675b1d27c1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047516 Aug 24 15:57:19.712093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 923/1871] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:19.747854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:19.750070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:19.756631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.757119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.757560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.758829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.759292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.759763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.790436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e179d098-830f-4464-b851-f13f0e2ee105 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046772 Aug 24 15:57:19.791008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 949/1872] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:20.134165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:20.136398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:20.142613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.143095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.143525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.144236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.144690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.145107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.175640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1971189c-b1a0-40a0-a7b4-d3ee1cf2853f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Aug 24 15:57:20.176208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 924/1873] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:20.289227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:20.291482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:20.297534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.298019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.298456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.299164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.299611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.300054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.331017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-05e411e5-14c6-4bf6-a6f4-94d79b520f2b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Aug 24 15:57:20.331576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 950/1874] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:20.723460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:20.725884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:20.731989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.732476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.732911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.733611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.734060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.734484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.769189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6c35b0cc-f603-464e-a38e-90a0153a55bb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049674 Aug 24 15:57:20.769951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 925/1875] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:20.802627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:20.805481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:20.812333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.812820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.813256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.813959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.814419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.814845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.846023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a2d30de7-31f6-4ec5-b4a5-f5d030f242f3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047441 Aug 24 15:57:20.846595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 951/1876] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:21.187620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:21.189816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:21.196384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.196935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.197367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.198083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.198529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.198947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.228464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a85301c4-a03a-44cf-87cd-442c8d4ce8de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Aug 24 15:57:21.229043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 926/1877] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:21.343472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:21.345617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:21.352614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.353134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.353550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.354258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.354717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.355148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.395002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0779b703-d307-40a3-9666-5dbce9afe69f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055481 Aug 24 15:57:21.395578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 952/1878] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:21.782415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:21.784994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:21.792215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.792698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.793455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.794164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.794662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.795080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.827486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8259cabf-a8c7-4c43-b2bd-f8287497baad tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Aug 24 15:57:21.828112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 927/1879] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:21.860095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:21.863216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:21.869835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.870398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.870990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.871788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.872323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.872860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.913050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-849be666-d060-43e9-a57d-41d2f9b0ff2f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057398 Aug 24 15:57:21.913633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 953/1880] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:22.240753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:22.243584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:22.250070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.250555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.250993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.251713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.252171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.252595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.283585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c8fdf6a0-7d92-43ab-80d5-e489d19593c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046719 Aug 24 15:57:22.284174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 928/1881] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:22.408497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:22.410689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:22.418090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.418587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.419027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.419766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.420227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.420652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.450905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-370aacae-e7bc-4629-a6c8-f943a156ba61 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046371 Aug 24 15:57:22.451474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 954/1882] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:22.839926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:22.842074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:22.848266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.848736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.849431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.850135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.850590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.851018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.881498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9fb96301-cbf5-4cd8-9fc7-db38524527d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 24 15:57:22.882081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 929/1883] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:22.926063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:22.928206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:22.935261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.935771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.936207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.936904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:22.937354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:22.937782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.968038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b92eb7f-dba2-4d66-bcb3-6e4dc9bc9291 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045876 Aug 24 15:57:22.968590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 955/1884] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:23.301361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:23.303542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:23.311212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.311728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.312172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.312880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.313334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.313760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.344503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3d0f121a-7709-44f5-85b2-3310f6092a5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Aug 24 15:57:23.345061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 930/1885] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:23.464195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:23.466267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:23.472526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.473073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.473561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.474571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.475077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.475555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.505675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-128e65fc-55af-4fe0-a898-f11bf89fd52c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Aug 24 15:57:23.506272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 956/1886] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:23.894851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:23.897073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:23.903116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.903595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.904070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.904754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.905205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.905630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.935232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6361a74c-55b4-4ecb-a265-3808585891bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Aug 24 15:57:23.935984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 931/1887] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:23.981542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:23.983687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:23.990054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.990534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.990995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.991716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.992167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.993202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.021930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6a645017-5fee-4467-ac51-57ead60a9cf0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045188 Aug 24 15:57:24.022479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 957/1888] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:24.357628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:24.359780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:24.366045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.366514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.366977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.368094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.368094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.368521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.396885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-735fab16-b437-44a5-9f86-e15022e5c0e1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Aug 24 15:57:24.397445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 932/1889] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:24.517044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:24.519211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:24.526390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.526879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.527353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.528095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.528558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.528994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.558225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-18ae3003-a0cd-4f27-aade-3fbb2397c17b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045163 Aug 24 15:57:24.558783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 958/1890] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:24.948849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:24.951009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:24.958661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.959154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.959593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.960329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.960782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.961826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.991138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f438e1e3-dc88-41e5-9363-31be5987cec0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047282 Aug 24 15:57:24.991722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 933/1891] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:25.034104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:25.036266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:25.042843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.043328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.043795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.044493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.044946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.045373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.047908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:25.076013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-769b4631-b64a-4537-ade1-9aeb4a3b6ab5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045737 Aug 24 15:57:25.076577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 959/1892] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:25.410154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:25.412334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:25.418801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.419287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.419759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.420462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.420916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.421346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.452266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a597062e-86c9-4aa3-b206-cad0eac87592 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Aug 24 15:57:25.452753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 934/1893] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:25.569590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:25.572367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:25.578483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.578973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.579416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.580157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.580616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.581128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.612329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98b8ee22-a553-4425-ad5f-bf93880606d8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046658 Aug 24 15:57:25.612891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 960/1894] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:26.002597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:26.004796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:26.011322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.011840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.012285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.012984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.013441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.013868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.046834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-88944519-2571-46f8-81cf-2b9075e6735e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Aug 24 15:57:26.047455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 935/1895] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:26.088963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:26.091118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:26.097562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.097982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.098418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.099361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.099854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.100279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.129405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4cb67c5-39ee-447a-8196-3bdf436b027f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044932 Aug 24 15:57:26.129953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 961/1896] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:57:26.465782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:26.467955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:26.474580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.475060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.475495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.476214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.476667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.477599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.506390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a9b508b8-c7ec-4463-af21-3257238b8226 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Aug 24 15:57:26.506942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 936/1897] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:26.624883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:26.626996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:26.632950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.634173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.634612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.635301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.635778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.636200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.681884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e12a083a-c926-4789-a640-7ece507d8221 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060693 Aug 24 15:57:26.682732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 962/1898] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:27.059868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:27.062077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:27.068155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.068636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.069089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.069765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.070219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.070667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.084578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:27.101460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-45807844-1529-457b-9d81-1e607f83feee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Aug 24 15:57:27.102620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 937/1899] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:27.144516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:27.146631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:27.153109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.153588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.154016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.154701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.155178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.155649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.186001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1b6bee75-4c15-4ff0-ad2e-a30cf7d67a97 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045415 Aug 24 15:57:27.186572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 963/1900] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:27.519800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:27.522257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:27.530765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.531326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.531811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.532511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.532960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.533385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.562743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-227eb239-94e8-4457-921d-ac6f5ee017e2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 24 15:57:27.563300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 938/1901] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:27.694746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:27.697455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:27.703516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.704034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.704471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.705168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.705622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.706052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.736234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-93872a04-5930-408f-995b-d61084ff1ba1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Aug 24 15:57:27.736799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 964/1902] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:28.114761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:28.116877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:28.123989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.124475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.124915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.125612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.126067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.126495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.157873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-db0245fe-fbb9-4eb0-bd7c-8948118b3c6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Aug 24 15:57:28.158445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 939/1903] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:28.198842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:28.201003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:28.206897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.207383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.207857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.208556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.209012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.209440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.238458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9f18d298-87fd-478c-9311-0de98091405d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044299 Aug 24 15:57:28.239004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 965/1904] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:28.575774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:28.577902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:28.584415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.584901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.585340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.586035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.586489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.587581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.617774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d88eed9d-12c0-4e41-ba87-c9eba1a6ae2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046449 Aug 24 15:57:28.619482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 940/1905] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:28.750743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:28.752933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:28.760771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.761268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.761711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.762425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.762887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.763315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.795772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-85fabbd1-b780-4444-a1cf-c1e9999891be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050546 Aug 24 15:57:28.796338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 966/1906] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:29.170997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:29.173258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:29.179378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.181178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.181178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.181178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.181483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.181802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.213751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-778c8a2a-d42c-4dc7-8ed0-90e490a21123 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046630 Aug 24 15:57:29.214326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 941/1907] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:29.250427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:29.252626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:29.258574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.259544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.260004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.260716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.261166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.261586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.290789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2eaac998-6db1-4efc-93ab-b92e6d91dbfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044315 Aug 24 15:57:29.291335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 967/1908] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:29.630881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:29.633350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:29.640645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.641132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.641569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.642267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.642722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.643145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.672990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8445d7c7-49fe-4885-ad87-ce3d8068a085 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Aug 24 15:57:29.673542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 942/1909] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:29.808903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:29.811073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:29.817489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.817966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.818394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.819093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:29.819542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:29.819989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.852179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-96371448-fa70-4fcb-bc4e-caa5aee6bf29 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047793 Aug 24 15:57:29.852812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 968/1910] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:30.225734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:30.228578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:30.234591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.235435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.235545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.236259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.236718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.237147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.268359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-26708cf1-b5f3-4a9b-8c3a-03976fa832c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046818 Aug 24 15:57:30.268922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 943/1911] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:30.302428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:30.304625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:30.311766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.312263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.312705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.313413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.313870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.314296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.344272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c89d4c15-7da5-4902-be29-7499a13e0a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045844 Aug 24 15:57:30.344834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 969/1912] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:30.685386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:30.687555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:30.693936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.694421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.694857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.695550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.696032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.697028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.726784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc60cc0a-c378-4e46-98bd-dda7b8938d14 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Aug 24 15:57:30.727325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 944/1913] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:30.864697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:30.867052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:30.873673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.874150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.874580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.875268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.875746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.876166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.906744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-df5f156e-d9af-42a1-b199-bcf4f16a0dbb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Aug 24 15:57:30.907297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 970/1914] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:31.281169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:31.283340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:31.289920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.291185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.291807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.292519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.292981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.293415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.324871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bdd60164-0a78-4dfd-8185-b060b2a08e6a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047074 Aug 24 15:57:31.324871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 945/1915] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:31.358454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:31.360797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:31.366771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.367260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.367721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.369138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.369602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.370034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.402198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-18edea5e-4d46-48c7-9dc6-7c805d7b38ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047837 Aug 24 15:57:31.402775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 971/1916] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:31.738542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:31.740725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:31.747791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.748279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.748721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.749421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.749877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.750304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.780524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e978990e-e264-4707-a147-eb66b80aa972 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045979 Aug 24 15:57:31.781079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 946/1917] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:31.918784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:31.920980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:31.927370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.927891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.928328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.929029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:31.929488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:31.931470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:31.961771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb8c1231-bbfa-47a1-9da5-a85c1b4bf7ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Aug 24 15:57:31.962532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 972/1918] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:32.336613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:32.338854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:32.345200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.345682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.346115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.346806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.347256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.347708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.377258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-821b75e7-02fc-4dcd-820d-af1ab04eb45e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Aug 24 15:57:32.377808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 947/1919] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:32.414633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:32.417401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:32.423550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.424052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.424483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.425173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.425620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.426040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.460452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3f3e83d-0108-47c8-93fa-c55e114e0166 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046236 Aug 24 15:57:32.460452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 973/1920] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:32.793012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:32.795155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:32.802756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.803242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.803700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.804403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.804901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.805725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.840606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5d32708a-dfa5-4772-856d-5c9a86d8c217 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052171 Aug 24 15:57:32.841181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 948/1921] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:32.974313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:32.976755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:32.984129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.984904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.985357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.986082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.986548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.986989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.017836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f957611-231e-4451-b777-e6e828d9f75e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047537 Aug 24 15:57:33.018476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 974/1922] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:33.389996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:33.392253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:33.398330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:33.398810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:33.399247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.400058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:33.400533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:33.400962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.429553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-780f7bdd-bc62-470d-be1d-645541b438f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Aug 24 15:57:33.430110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 949/1923] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:33.469608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:33.471800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:33.478235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:33.478720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:33.479150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.479873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:33.480322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:33.480740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.506110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:33.513870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9890b6ec-52b4-44ef-bd0f-a10959aa5053 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047216 Aug 24 15:57:33.513870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 975/1924] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:33.854098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:33.856254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:33.862553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:33.863026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:33.863451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.864169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:33.864613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:33.865031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:33.894718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a9c1545e-726e-48b4-a84b-5129bd3b3d2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Aug 24 15:57:33.895280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 950/1925] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:34.030351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:34.032457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:34.039677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.040664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.041098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.041803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.042255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.042679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.072022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8fad9e18-eb24-4095-bb7a-084e9bb6952a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045632 Aug 24 15:57:34.072583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 976/1926] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:34.442514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:34.444652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:34.451029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.451500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.451964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.452648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.453093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.453510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.482871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc27efe3-b620-4aef-97ae-6ea3d0368e73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 24 15:57:34.483422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 951/1927] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:34.526010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:34.528423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:34.534471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.534958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.535392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.536121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.536574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.537000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.567490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-06514bce-11e5-43de-9ac9-496e3f7a7271 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046395 Aug 24 15:57:34.568292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 977/1928] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:34.907023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:34.909308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:34.916542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.917026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.917484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.918162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:34.918617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:34.919040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:34.950464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71dd78a3-8ec6-48ef-a935-250feae626f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047342 Aug 24 15:57:34.951040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 952/1929] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:35.084330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:35.086462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:35.093353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.093841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.094279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.094973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.095432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.095885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.127432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bd3cb595-6d73-43bc-be94-770ec333e325 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046937 Aug 24 15:57:35.127950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 978/1930] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:35.495916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:35.498243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:35.504512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.505077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.505549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.506262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.506723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.507155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.539480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d33a3e37-840f-4596-8848-7c2179af8642 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Aug 24 15:57:35.540585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 953/1931] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:35.581471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:35.583780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:35.590657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.591143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.591581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.592335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.592781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.593358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.626737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a91d11c9-fce7-4340-b91f-04f0cccd9588 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049841 Aug 24 15:57:35.631387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 979/1932] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:35.963668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:35.965814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:35.972182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.972658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.973086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.973881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:35.974331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:35.975018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:35.977333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:36.004306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-34d07f56-0b9f-4ade-a8aa-289e40516917 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045457 Aug 24 15:57:36.004850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 954/1933] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:36.140817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:36.142989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:36.150625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:36.150860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:36.151304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:36.152031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:36.152485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:36.152910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:36.182581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-230c2d37-791c-45fc-9f27-7f6774e5089c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Aug 24 15:57:36.183136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 980/1934] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:36.553399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:36.555606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:36.562713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:36.563203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:36.563734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:36.564452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:36.564921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:36.565342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:36.594472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f39d0002-f9a0-4831-92ec-b6ba3ca8ebd5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Aug 24 15:57:36.595145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 955/1935] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:36.639898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:36.642055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:36.648058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:36.648549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:36.648985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:36.649748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:36.650277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:36.650739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:36.682273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4767ab45-e828-4446-abae-8d0440922383 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046782 Aug 24 15:57:36.682857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 981/1936] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:37.016453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:37.018594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:37.025057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.025628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.026059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.026749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.027225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.027651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.057651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7a2b88db-27ac-4146-a664-8abb4f57e805 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Aug 24 15:57:37.058286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 956/1937] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:37.194495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:37.196851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:37.203433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.203974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.204448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.205196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.205650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.206072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.236338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a8ab1bd1-1b42-42b2-8459-d431dde5464d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Aug 24 15:57:37.236894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 982/1938] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:37.607123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:37.609273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:37.615233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.615756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.616194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.616887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.617337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.617760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.649222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0e209a6b-e84d-4ee2-af27-1b88f9453d01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Aug 24 15:57:37.650675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 957/1939] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:37.694303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:37.697089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:37.703382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.703910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.704357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.705064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:37.705522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:37.705950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:37.739736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf7120b0-376f-411a-8584-36c504aedbf2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049351 Aug 24 15:57:37.740306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 983/1940] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:38.070189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:38.073536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:38.079951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.080439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.080878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.081577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.082031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.082459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.112344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc5fe29f-6941-4660-8265-5a63cbb03d51 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 Aug 24 15:57:38.112895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 958/1941] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:38.249319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:38.251453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:38.258661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.259380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.259929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.260638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.261092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.261514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.290886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e063f81d-df71-4d5b-8ac3-ea93f4f6678d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 24 15:57:38.291644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 984/1942] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:38.662588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:38.664773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:38.671704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.672192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.672635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.673325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.673779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.674204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.702923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-065ed1ca-05aa-4830-a892-b43c7b2d73ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Aug 24 15:57:38.703478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 959/1943] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:38.753322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:38.755661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:38.762490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.762984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.763425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.764398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.764861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.765376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.797977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7259bd6e-28d2-4915-ab44-a94bebaf3530 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048917 Aug 24 15:57:38.798558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 985/1944] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:57:38.816013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:38.816511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:38.818316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:38.824541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.825033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.825472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.826176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:38.826630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:38.827053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:38.953698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lazy-loading 'services' on Instance uuid f68e3c94-e105-482d-916a-1e70d8b64373 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:57:39.025890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e31e068f-225b-4f98-b354-6a7dbe610074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "DELETE /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373/os-volume_attachments/e894f144-a7dd-4a87-882c-c80de8e6ba7d" status: 202 len: 0 microversion: 2.1 time: 0.213726 Aug 24 15:57:39.026476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 960/1945] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:57:38 2022] DELETE /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373/os-volume_attachments/e894f144-a7dd-4a87-882c-c80de8e6ba7d => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:57:39.125688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:39.127875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:39.133816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.134369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.134829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.135512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.135996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.136421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.166463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b978d8f-a86f-4248-a7f0-87eb79f17ac6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Aug 24 15:57:39.167013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 986/1946] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:39.304110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:39.307104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:39.313298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.313776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.314209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.314894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.315337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.315788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.344741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e20ebd17-9516-42ed-b065-5fcda7ef0abe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Aug 24 15:57:39.345622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 961/1947] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:39.715433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:39.717664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:39.720139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:39.726006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.726494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.726932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.727720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.728277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.728748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.757771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c0268247-0337-43c9-8ca4-60e873c28100 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Aug 24 15:57:39.758340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 987/1948] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:39.810779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:39.812981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:39.818931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.819526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.819881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.820585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:39.821038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:39.822117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:39.854159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f72671ed-7743-4494-acf8-72bab7522582 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047990 Aug 24 15:57:39.854719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 962/1949] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:40.178824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:40.181042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:40.187482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.188011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.188465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.189172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.189627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.190052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.220283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3bb74d3-d5e3-4b36-94a4-8dcebd9b83eb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Aug 24 15:57:40.220852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 988/1950] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:40.357240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:40.359360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:40.365732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.366217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.366646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.367333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.367812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.368232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.397056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-26039797-6d46-4e8d-9bf8-3bfe7c41c4a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Aug 24 15:57:40.397601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 963/1951] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:40.770602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:40.772812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:40.779602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.780110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.780541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.781224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.781676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.782087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.811124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ff72e3a-0005-4139-8d57-1c07e592214f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Aug 24 15:57:40.811699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 989/1952] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:40.866330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:40.868464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:40.874997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.875474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.875947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.876639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:40.877083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:40.877502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:40.906972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7aeefc62-5428-4c73-8eb5-ccfdc83c4f73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044546 Aug 24 15:57:40.907526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 964/1953] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:57:41.233228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:41.235420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:41.241369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.241847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.242281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.242965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.243420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.243866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.272286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-29a79bf8-35f8-4791-a8a4-4a94d1f0f7a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Aug 24 15:57:41.272839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 990/1954] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:41.410509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:41.412720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:41.421554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.422043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.422475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.423182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.423654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.424086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.453312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8326f3f9-ed60-49d4-a0c5-a410fd1d22ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047163 Aug 24 15:57:41.453861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 965/1955] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:41.822926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:41.825689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:41.832210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.832697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.833131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.833830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.834290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.834709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.864905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9f7f5e8d-460c-41f7-8075-fb559399c925 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Aug 24 15:57:41.865474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 991/1956] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:41.918949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:41.921112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:41.927188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.927724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.928169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.928874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:41.929334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:41.929763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:41.962259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e8a9c77b-39bd-4862-8280-8fb817cf77ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047919 Aug 24 15:57:41.962824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 966/1957] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:42.286005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:42.288205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:42.294773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.295258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.295732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.296427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.296878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.297303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.311481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:42.327469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4a5cc73f-1cd6-4ce4-988b-5dd9f6117653 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Aug 24 15:57:42.328079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 992/1958] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:42.476320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:42.478374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:42.486096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.486591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.487057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.487799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.488264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.488700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.519080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6483495-a87c-4de2-851f-eb0c25a84e0c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057210 Aug 24 15:57:42.519656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 967/1959] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:42.876576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:42.878703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:42.885045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.885520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.886198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.886887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.887337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.887790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.916327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-84dfc65b-3de9-4a46-9f8a-4066b55c26e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 Aug 24 15:57:42.916872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 993/1960] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:42.974413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:42.976812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:42.983849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.984502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.985041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:42.985912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:42.986460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:42.986980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.017262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f65c851b-0fcf-4e53-8d03-93116956621a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046762 Aug 24 15:57:43.017821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 968/1961] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:43.340347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:43.342454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:43.348352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:43.348829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:43.349257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.349946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:43.350645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:43.351063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.379110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d056a1ce-918f-4d8f-8bca-440d2dbebe24 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043367 Aug 24 15:57:43.379684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 994/1962] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:43.531618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:43.533707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:43.540198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:43.540683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:43.541118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.541816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:43.542319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:43.542783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.572028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f0b7b1ff-eb9d-4d72-b242-f0d959cdcdd2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Aug 24 15:57:43.572578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 969/1963] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:43.929392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:43.931739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:43.938931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:43.939420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:43.939884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.940603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:43.941063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:43.941490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:43.971744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2bcf9b88-b0c8-4637-b78c-8ae5b85cb246 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046210 Aug 24 15:57:43.972324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 995/1964] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:44.029027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:44.031177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:44.037166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.037657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.038233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.038941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.039452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.039842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.044175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:44.072146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7eb44d6a-ef41-46b8-a5f9-856b00c58029 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047221 Aug 24 15:57:44.072711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 970/1965] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:44.390549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:44.392753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:44.398717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.399655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.400358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.400842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.401266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.431352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cfde07bd-2d6a-44f1-b34c-745bec5152ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Aug 24 15:57:44.431948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 996/1966] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:44.586623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:44.588731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:44.595994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.596478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.596912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.597601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.598054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.598473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.627268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb5df238-e329-4eb1-b14c-4e6bc6011888 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Aug 24 15:57:44.627860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 971/1967] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:44.986033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:44.988218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:44.994580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.995588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.996638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:44.997340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:44.997803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:44.998233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.028113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-be17574a-f79a-4624-9b36-6c701701d27a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 Aug 24 15:57:45.028676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 997/1968] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:45.084875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:45.086929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:45.093501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:45.094053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:45.094560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.095344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:45.095824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:45.096246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.125807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0949ad0f-e8bc-475d-9075-012afc3b3306 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045125 Aug 24 15:57:45.126357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 972/1969] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:45.443678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:45.445863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:45.452259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:45.452738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:45.453167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.453856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:45.454299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:45.454724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.483799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a437b61d-836f-4996-944e-19fed48cb0ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Aug 24 15:57:45.484347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 998/1970] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:45.639244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:45.641458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:45.647925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:45.648404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:45.648837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.649524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:45.649975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:45.650407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:45.683579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-525dbb16-2c0c-49f2-ba6b-1d4f896b57b7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Aug 24 15:57:45.684222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 973/1971] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:46.040551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:46.042870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:46.049294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.049779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.050217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.050909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.051365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.051823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.081098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e25b0a8e-d7b0-4801-ab81-b64104965bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Aug 24 15:57:46.081656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 999/1972] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:46.139052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:46.141296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:46.147389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.147909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.148347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.149047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.149501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.149930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.181480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-70f7c8c4-1ea3-4d43-b38b-9052fef73a1b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047324 Aug 24 15:57:46.182044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 974/1973] 10.222.0.102 () {60 vars in 1348 bytes} [Wed Aug 24 15:57:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:57:46.496473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:46.498631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:46.504549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.505026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.505456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.506136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.506585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.507003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.537339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-23a0980e-e977-4939-9551-dffbeec81f12 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Aug 24 15:57:46.537883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1000/1974] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:46.696230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:46.698295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:46.705650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.706138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.706578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.707279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:46.707775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:46.708205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:46.737696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2cdd9507-0f7c-42c6-9a74-d8c30f0eed0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Aug 24 15:57:46.738257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 975/1975] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:47.093780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:47.095867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:47.102702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.103191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.103737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.104350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.105385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.105984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.134791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-065b25d5-d80a-4070-b076-528e142df396 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045259 Aug 24 15:57:47.135345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1001/1976] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:47.194270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:57:47.196442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:47.204219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.204712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.205146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.205853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.206337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.206715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.305265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-953fff9a-7696-4a16-9ec2-91356e313417 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/action" status: 200 len: 37577 microversion: 2.20 time: 0.114733 Aug 24 15:57:47.305890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 976/1977] 10.222.0.102 () {62 vars in 1324 bytes} [Wed Aug 24 15:57:47 2022] POST /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d/action => generated 37577 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:57:47.549474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:47.551772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:47.558473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.558988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.559395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.560124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.560579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.561000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.590068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7f416777-1d41-497d-b431-b9988fd82d45 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Aug 24 15:57:47.590625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1002/1978] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:47.751075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:47.753354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:47.760434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.760949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.761390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.762087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:47.762542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:47.762964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:47.793209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b54db8cc-9552-4878-ac68-ed52fbaa3b40 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Aug 24 15:57:47.793766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 977/1979] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:48.146833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:48.148995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:48.155942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:48.156443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:48.156877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:48.157594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:48.158040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:48.158488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:48.191243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e04f044b-083b-44b8-9da7-d9655e0c4e8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048380 Aug 24 15:57:48.191858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1003/1980] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:48.602747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:48.605540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:48.612023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:48.612508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:48.612940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:48.613630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:48.614087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:48.614508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:48.644438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-edfdeb25-0908-4903-acac-bdd45548d6d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Aug 24 15:57:48.645001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 978/1981] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:48.805653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:48.807720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:48.814215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:48.814699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:48.815134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:48.815866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:48.816326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:48.816753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:48.848037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-830e6e2e-c5c4-4d63-addb-0b8efc1e2536 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Aug 24 15:57:48.848037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1004/1982] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:49.203973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:49.206131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:49.212672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:49.213157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:49.213596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:49.214470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:49.214759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:49.215187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:49.244556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9b403418-89ed-4ab4-a5f3-a6b5155f9824 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Aug 24 15:57:49.245111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 979/1983] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:49.657169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:49.659433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:49.667879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:49.668528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:49.669125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:49.669858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:49.670321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:49.670757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:49.700056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e6f6be0-af0e-4f08-a63a-8391ea1c7b5d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Aug 24 15:57:49.700618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1005/1984] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:49.860274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:49.862416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:49.868881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:49.869364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:49.869801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:49.870566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:49.871144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:49.871578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:49.901071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e5fcfcda-33f5-42d6-a5a3-efa6fc8af496 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Aug 24 15:57:49.902285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 980/1985] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:50.257156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:50.259290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:50.265936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:50.266413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:50.266843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:50.267532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:50.268009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:50.268428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:50.296029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa80b05f-a144-4be0-b0dc-168734ecc0fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 Aug 24 15:57:50.296576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1006/1986] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:50.712182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:50.714521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:50.721152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:50.721632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:50.722066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:50.722762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:50.723213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:50.723657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:50.754041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-114d2773-8ef4-4420-8b20-028673aef868 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045750 Aug 24 15:57:50.754604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 981/1987] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:50.914328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:50.916634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:50.927850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:50.928349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:50.928800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:50.929515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:50.929971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:50.930392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:50.963595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a6fbeb9f-d2fd-4c39-a10a-abb82662322a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053157 Aug 24 15:57:50.964693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1007/1988] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:51.307886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:51.310219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:51.316642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:51.317122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:51.317560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:51.318254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:51.318708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:51.319134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:51.348301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-53bab75a-c76f-4f8e-813f-ed22d95a54d6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Aug 24 15:57:51.348867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 982/1989] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:51.766942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:51.769107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:51.775150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:51.775543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:51.775995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:51.777261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:51.778095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:51.778257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:51.808429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-664a26b9-58ce-442a-a26c-c6f9e8713516 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 24 15:57:51.808844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1008/1990] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:51.977003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:51.979136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:51.985723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:51.986214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:51.986656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:51.987361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:51.987855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:51.988285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:52.018323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3725bec9-0267-45b7-badb-57b99a8e058d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Aug 24 15:57:52.018882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 983/1991] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:52.360990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:52.363158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:52.369597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:52.370077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:52.371066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:52.371818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:52.372273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:52.372697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:52.375033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:52.402710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a84b3295-d5a6-4599-8237-67915ed50a42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Aug 24 15:57:52.403272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1009/1992] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:52.820796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:52.824645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:52.830639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:52.831134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:52.831606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:52.832345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:52.832803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:52.833234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:52.865097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-884421fc-3f21-4b65-8186-299be10e212b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Aug 24 15:57:52.865587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 984/1993] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:53.031260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:53.033427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:53.039376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:53.039941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:53.040334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:53.041032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:53.041484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:53.041908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:53.071402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-50b72827-deb8-47ae-81b5-1d5cfe40395d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Aug 24 15:57:53.071995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1010/1994] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:53.415043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:53.417271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:53.423191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:53.423701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:53.424137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:53.424828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:53.425279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:53.425710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:53.454450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a3fc4ac4-4480-44e7-9bc8-1795c9198067 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Aug 24 15:57:53.455086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 985/1995] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:53.877645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:53.879883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:53.887305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:53.887875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:53.888369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:53.889087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:53.889549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:53.889975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:53.920270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c491c84d-8207-4fec-8be8-8116a580d6be tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Aug 24 15:57:53.920842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1011/1996] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:54.083734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:54.085887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:54.092484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:54.092972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:54.093409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:54.094101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:54.094553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:54.094978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:54.124735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-985ab1af-0106-4c9b-b2f9-5891fa5dff72 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Aug 24 15:57:54.125211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 986/1997] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:54.467463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:54.469650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:54.475709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:54.476455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:54.476896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:54.477590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:54.478048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:54.478476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:54.510078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0e1008b1-77e6-433a-88f2-2ce0f4549ce8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047538 Aug 24 15:57:54.510652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1012/1998] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:54.934483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:54.936752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:54.942919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:54.943405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:54.943918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:54.944639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:54.945093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:54.945524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:54.948403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:54.981433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5faf1078-1bfc-473d-9079-37ab1f7395b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051147 Aug 24 15:57:54.982082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 987/1999] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:55.138329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:55.140329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:55.146779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:55.147253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:55.147718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:55.148410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:55.148862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:55.149280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:55.177896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b45fa58f-b10d-410f-81cb-c085c4565c62 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Aug 24 15:57:55.178444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1013/2000] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:55.522511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:55.524804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:55.531532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:55.532049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:55.532483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:55.533183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:55.533635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:55.534062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:55.565054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aeed22a7-f346-4d74-8321-1c7908f11305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046505 Aug 24 15:57:55.565707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 988/2001] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:55.993931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:55.996151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:56.002851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:56.003678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:56.004241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:56.005090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:56.005790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:56.006440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:56.039929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf12476f-9228-4704-94d1-b2886bff2afb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049811 Aug 24 15:57:56.040732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1014/2002] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:56.190220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:56.192363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:56.198369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:56.199426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:56.199888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:56.200584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:56.201035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:56.201459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:56.230878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-99eb2788-1750-4dba-b204-54b46307a6c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Aug 24 15:57:56.231500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 989/2003] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:56.578204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:56.580324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:56.586762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:56.587246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:56.587704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:56.588406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:56.588854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:56.589945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:56.619002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e3d45ed5-3d2a-40d6-8824-8d34af5769a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Aug 24 15:57:56.619555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1015/2004] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:57.053093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:57.055263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:57.062955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:57.063581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:57.064216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:57.064939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:57.065431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:57.065864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:57.096064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-33693e82-7f4a-4041-939d-1195980119db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 Aug 24 15:57:57.096544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 990/2005] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:57.243310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:57.246060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:57.252169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:57.252674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:57.253121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:57.253816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:57.254265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:57.254691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:57.286879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a18c829f-40bd-4a6a-9b0b-9f40bcd9ce67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Aug 24 15:57:57.287496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1016/2006] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:57.630826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:57.633027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:57.639435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:57.639956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:57.640400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:57.641110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:57.641563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:57.641992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:57.674641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2fb5b1e1-38f6-4d95-95e3-5a5339c6bfc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047737 Aug 24 15:57:57.675227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 991/2007] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:58.109170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:58.111325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:58.117435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:58.117946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:58.118378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:58.119069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:58.119518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:58.119971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:58.149751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9ff8ba87-dd57-479e-968c-713ba534cac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045497 Aug 24 15:57:58.150307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1017/2008] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:58.299730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:58.303157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:58.310554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:58.311032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:58.311460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:58.312239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:58.312684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:58.313102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:58.341356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb4f3a9b-c320-42fe-bbf1-aef755d31bdb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045741 Aug 24 15:57:58.341904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 992/2009] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:58.687440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:58.689616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:58.696020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:58.696503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:58.696937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:58.697631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:58.698084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:58.698508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:58.727653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b263ff19-6a42-49fe-bcfa-9caaa2a7cfd7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Aug 24 15:57:58.728217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1018/2010] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:59.163791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:59.166265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:59.173003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:59.173544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:59.174013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:59.174783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:59.175305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:59.175794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:59.207736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9444ec12-8409-4c37-8d24-9febde73e7aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048403 Aug 24 15:57:59.208634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 993/2011] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:59.354041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:59.356284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:59.362398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:59.362888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:59.363331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:59.364065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:59.364524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:59.364951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:59.396331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb737554-7a39-498a-a8c6-17dd350cc887 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046481 Aug 24 15:57:59.396897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1019/2012] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:59.741297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:59.743493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:59.750621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:59.751098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:59.751528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:59.752261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:59.752867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:59.753299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:59.783128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0370fe39-6153-45ff-99ad-8acf2f01eb03 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Aug 24 15:57:59.783709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 994/2013] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:57:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:00.219511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:00.221710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:00.228435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:00.228921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:00.229352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:00.230227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:00.230724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:00.231154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:00.262678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e60113c-9431-44d5-b75a-011c2c7faafc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047080 Aug 24 15:58:00.263251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1020/2014] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:00.408997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:00.411144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:00.417104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:00.418324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:00.419181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:00.419925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:00.420381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:00.420810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:00.450961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f01420ab-006f-4dd5-a45f-d045f0e704a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Aug 24 15:58:00.451519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 995/2015] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:00.795354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:00.797558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:00.803586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:00.804104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:00.804544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:00.805245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:00.805696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:00.806125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:00.837081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aedf5344-95b9-4b2a-ab17-a3c99a786920 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046292 Aug 24 15:58:00.837658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1021/2016] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:01.275312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:01.277739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:01.284542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:01.285034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:01.285474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:01.286179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:01.286631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:01.287056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:01.322842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-339f2996-acb6-42ce-8713-cbc775a06973 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Aug 24 15:58:01.322842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 996/2017] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:01.462447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:01.465086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:01.471547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:01.472064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:01.472497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:01.473183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:01.473632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:01.474056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:01.503472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a54e8327-a171-4262-8afa-69cf204377c8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Aug 24 15:58:01.504052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1022/2018] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:01.849515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:01.851957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:01.861544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:01.862038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:01.862472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:01.863174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:01.863623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:01.864080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:01.893995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-75aad4c3-c0fa-45d6-8aa6-2543b5f050bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048530 Aug 24 15:58:01.894554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 997/2019] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:02.332432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:02.335849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:02.342134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:02.342622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:02.343072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:02.343810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:02.344272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:02.344700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:02.375833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-93e4eef8-1539-4563-bc7b-2e7c0eb76bf6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047233 Aug 24 15:58:02.376357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1023/2020] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:02.515655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:02.517823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:02.524272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:02.524755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:02.525186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:02.525878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:02.526331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:02.526757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:02.556249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8a5abf53-405b-405f-ad66-1ae4c1ce42f8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 24 15:58:02.556805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 998/2021] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:02.905927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:02.908122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:02.914450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:02.914925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:02.915359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:02.916360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:02.916528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:02.916952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:02.949082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dfeb89d4-1bd5-47a1-bec4-5a387c05a82a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044961 Aug 24 15:58:02.949082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1024/2022] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:03.388991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:03.391167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:03.397162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:03.397645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:03.398069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:03.398759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:03.399210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:03.399655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:03.430603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c865419f-a8dd-4519-acf0-b00a3e6d59ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Aug 24 15:58:03.431106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 999/2023] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:03.568711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:03.570850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:03.577499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:03.577991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:03.578432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:03.579136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:03.579594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:03.580053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:03.604880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:03.610342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c342f6d5-96a7-41f2-bb3b-d8bf7f4b370e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Aug 24 15:58:03.610913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1025/2024] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:03.958614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:03.961039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:03.967624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:03.968137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:03.968570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:03.969272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:03.969732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:03.970198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:04.007715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-764fd095-d92d-4c92-b462-f3106a4ab6d3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053021 Aug 24 15:58:04.008283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1000/2025] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:04.442546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:04.444706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:04.451193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:04.451706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:04.452149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:04.452850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:04.453303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:04.453729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:04.485888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c1bbdda7-2fe8-4381-b00d-286fdf7171d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 Aug 24 15:58:04.487281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1026/2026] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:04.622854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:04.625025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:04.630925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:04.631399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:04.631869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:04.632550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:04.632998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:04.633414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:04.662757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-51e0ea76-78c6-4c20-b3eb-29746bc63da0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 24 15:58:04.663229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1001/2027] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:05.020030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:05.022081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:05.028042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:05.029074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:05.029511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:05.030206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:05.030661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:05.031083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:05.059325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4a253460-19d1-4525-8ec7-3b1b01d2c035 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Aug 24 15:58:05.059899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1027/2028] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:05.498782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:05.500986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:05.507881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:05.508349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:05.508785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:05.509486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:05.509943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:05.510367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:05.541172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3779fcc0-b6b7-4e86-a15f-2efdc97a29ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Aug 24 15:58:05.541742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1002/2029] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:05.675158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:05.677367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:05.683949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:05.685227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:05.685883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:05.686599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:05.687066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:05.687502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:05.718220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9bb193ec-4862-4a0e-9800-00bd003b8c93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Aug 24 15:58:05.719001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1028/2030] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:06.072177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:06.074334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:06.080337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:06.080823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:06.081251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:06.081942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:06.082421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:06.082842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:06.107787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:06.113441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1ce951a6-e230-4c82-92ab-0a7a9b4e7305 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Aug 24 15:58:06.114002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1003/2031] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:06.554539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:06.556732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:06.563226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:06.563732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:06.564176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:06.564869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:06.565324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:06.565755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:06.597175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-40cf507a-123c-4204-8838-3a07560291cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Aug 24 15:58:06.598061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1029/2032] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:06.730982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:06.733482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:06.740193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:06.740681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:06.741123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:06.741830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:06.742289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:06.742718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:06.773492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2093222b-ba21-4f05-9888-871d37aa5a39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046732 Aug 24 15:58:06.773969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1004/2033] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:07.126525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:07.128703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:07.135218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:07.135745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:07.136185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:07.136894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:07.137352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:07.137871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:07.167725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4c6f3906-96ce-43b1-8824-29e9ed9c409f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Aug 24 15:58:07.168294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1030/2034] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:07.610474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:07.612645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:07.618763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:07.619291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:07.619771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:07.620473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:07.620926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:07.621348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:07.651000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-66d6b7d2-d506-410a-ae43-7d23840dda95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Aug 24 15:58:07.651560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1005/2035] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:07.785737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:07.787944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:07.794045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:07.794538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:07.794969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:07.795706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:07.796147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:07.796581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:07.825391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9d0ef239-1bb7-4e75-b7d2-93c6cc3b105d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Aug 24 15:58:07.825871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1031/2036] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:08.180608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:08.182977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:08.190489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:08.190969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:08.191403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:08.192133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:08.192594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:08.193014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:08.222708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ee5da46b-1026-482c-831d-7a542b00c736 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046333 Aug 24 15:58:08.223273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1006/2037] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:08.663780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:08.665983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:08.674836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:08.675329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:08.675819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:08.676519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:08.676969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:08.677394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:08.708006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b9c942a9-424c-4667-8aea-f47d8a0b6895 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048208 Aug 24 15:58:08.708576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1032/2038] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:08.838346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:08.840670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:08.843071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=94 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:08.848860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:08.849357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:08.849798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:08.850514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:08.850970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:08.851403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:08.881508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-396ed709-ae23-45a3-b198-3435055f23cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047139 Aug 24 15:58:08.882067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1007/2039] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:09.235326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:09.237546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:09.243459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:09.243979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:09.244413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:09.245102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:09.245553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:09.245974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:09.274919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6177f19c-1f44-45cc-8927-6e08bf931d9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Aug 24 15:58:09.275481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1033/2040] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:09.721269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:09.723477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:09.730417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:09.730907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:09.731345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:09.732090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:09.732544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:09.733066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:09.765317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-02c32064-eaa8-40f9-a625-f33f67116f00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047977 Aug 24 15:58:09.770553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1008/2041] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:09.894662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:09.896739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:09.899054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=94 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:09.905025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:09.906150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:09.906743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:09.907457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:09.907974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:09.908385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:09.937734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-294d910e-f8c2-4b5d-94be-362c3e902cf1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047051 Aug 24 15:58:09.938488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1034/2042] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:10.287450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:10.289631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:10.295591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:10.296106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:10.296543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:10.297240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:10.297689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:10.298114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:10.329459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c4e33df1-2a50-4cab-8f33-7ca00b36102b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Aug 24 15:58:10.330062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1009/2043] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:10.777186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:10.779378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:10.786026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:10.786511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:10.786948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:10.787670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:10.788139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:10.788564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:10.818580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3b2755fd-2781-43ee-bbb5-da6a12d9868c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Aug 24 15:58:10.819149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1035/2044] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:10.952673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:10.954833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:10.961263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:10.961745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:10.962338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:10.963036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:10.963485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:10.963935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:10.994195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-41a6d482-71f3-4a9b-88c0-c6253e1a10f9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Aug 24 15:58:10.994675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1010/2045] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:11.341801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:11.344529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:11.351087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:11.351575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:11.352300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:11.353006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:11.353464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:11.353893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:11.382044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-53894df1-0795-4d0e-97e2-5f1197dd1205 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 24 15:58:11.382590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1036/2046] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:11.831216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:11.833459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:11.839415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:11.839929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:11.840359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:11.841095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:11.841540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:11.841968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:11.873438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-427a4358-3609-4058-96e5-a31a4f3401d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046948 Aug 24 15:58:11.874840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1011/2047] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:12.006651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:12.008839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:12.015478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:12.015996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:12.016433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:12.017140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:12.017595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:12.018020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:12.046704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8271da11-5209-497f-af11-5322d21808ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Aug 24 15:58:12.047195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1037/2048] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:12.394669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:12.396845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:12.403442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:12.403964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:12.404408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:12.405107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:12.405649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:12.406083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:12.436226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-068f6b15-41ef-43eb-808e-93ca66f46518 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Aug 24 15:58:12.436799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1012/2049] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:12.886301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:12.888505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:12.895794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:12.896284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:12.896720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:12.897416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:12.897880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:12.898309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:12.931007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8bac01cd-8aaa-40f4-9d9b-9f4ad4b6a5bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048416 Aug 24 15:58:12.931607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1038/2050] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:13.058798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:13.060951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:13.067000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:13.067415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:13.067887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:13.068574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:13.069022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:13.069442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:13.099797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-459fcf7a-c3a4-4525-9937-c3ff4dcb32b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Aug 24 15:58:13.100365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1013/2051] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:13.449513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:13.451667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:13.458397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:13.458878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:13.459312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:13.460025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:13.460479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:13.460909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:13.489299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-757d8852-2a32-4180-8c13-b4d6a52f1b78 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Aug 24 15:58:13.489855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1039/2052] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:13.943135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:13.945345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:13.951986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:13.952513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:13.952952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:13.953657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:13.954112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:13.954537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:13.985729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-57e5d6ea-67fe-4fc0-af70-5b8a94cf4915 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046483 Aug 24 15:58:13.986521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1014/2053] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:14.112934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:14.114952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:14.121400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:14.121874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:14.122303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:14.122990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:14.123439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:14.123900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:14.154591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1b7c0de9-01a0-4e25-99e4-d64486a2a564 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046183 Aug 24 15:58:14.155151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1040/2054] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:14.502680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:14.504847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:14.510769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:14.511254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:14.511725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:14.512422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:14.512876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:14.513304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:14.542089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4870c11d-b9e3-4f26-89fd-8e4e8856f9ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Aug 24 15:58:14.542655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1015/2055] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:15.000853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:15.003013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:15.009202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:15.009685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:15.010121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:15.010816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:15.011270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:15.011731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:15.041712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cf1bcc1e-e481-4a9a-8216-71b725645dab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Aug 24 15:58:15.042287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1041/2056] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:15.168306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:15.171016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:15.176959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:15.177445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:15.177887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:15.178586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:15.179041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:15.179470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:15.209387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fc1d96c8-6593-41aa-a212-5c4b030035d6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Aug 24 15:58:15.209952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1016/2057] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:15.554682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:15.556770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:15.564020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:15.564507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:15.564945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:15.565646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:15.566105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:15.566533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:15.581356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:15.597094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-00d1c101-5c4b-42cb-aab3-54055ec5a4cd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046431 Aug 24 15:58:15.597672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1042/2058] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:16.053846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:16.055991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:16.062546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:16.063005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:16.063431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:16.064146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:16.064593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:16.065015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:16.094455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b6a049ab-e7a2-4ee3-8f2b-a0e77ce3c3e9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Aug 24 15:58:16.095014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1017/2059] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:16.222570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:16.224736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:16.230898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:16.231382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:16.231855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:16.232543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:16.232990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:16.233416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:16.262318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-25aaa1fc-d99e-4d29-b4fb-feae52a0ab42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Aug 24 15:58:16.262860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1043/2060] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:16.608896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:16.611096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:16.617517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:16.618001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:16.618442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:16.619136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:16.619586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:16.620043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:16.650028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a5f0c4f8-e82b-44fa-8ffc-c4faac22bcbd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 24 15:58:16.650771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1018/2061] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:17.107710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:17.110770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:17.116738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:17.117219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:17.117649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:17.118393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:17.118845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:17.119262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:17.148291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-62b8741b-c17e-4a92-8124-91c0781fa20b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Aug 24 15:58:17.148843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1044/2062] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:17.274517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:17.276669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:17.283371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:17.283885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:17.284327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:17.285018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:17.285473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:17.285897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:17.314163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5c1e555d-24e6-410e-bb88-e3a371b3fbbc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Aug 24 15:58:17.314716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1019/2063] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:17.662495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:17.664766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:17.671465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:17.672034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:17.672517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:17.673246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:17.673702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:17.674178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:17.704610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ac2ca275-e7fb-42d1-bf31-3c4bc49eccd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046119 Aug 24 15:58:17.705196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1045/2064] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:18.160595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:18.162740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:18.169673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:18.170093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:18.170524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:18.171225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:18.171702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:18.172621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:18.186603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:18.203904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ae03e002-e6ae-4bf9-8e3a-62e07e3509db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Aug 24 15:58:18.204469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1020/2065] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:18.326564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:18.328880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:18.335411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:18.335959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:18.336408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:18.337109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:18.337568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:18.337997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:18.368829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f123eed1-fc31-480c-b07b-a1222f76a7c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046333 Aug 24 15:58:18.369387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1046/2066] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:18.717633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:18.720598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:18.726556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:18.727039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:18.727748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:18.728451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:18.728996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:18.729497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:18.761768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-81e9d38b-1d50-496b-8561-5dbc21058301 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048259 Aug 24 15:58:18.762426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1021/2067] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:19.216016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:19.218193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:19.224934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:19.225426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:19.225876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:19.226578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:19.227036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:19.227467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:19.258538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-280e4631-d591-42b1-9c3c-93a9d3ab5ded tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 24 15:58:19.259094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1047/2068] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:19.381501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:19.383656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:19.390146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:19.390646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:19.391743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:19.392600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:19.393049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:19.393471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:19.424763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a7925c96-a5c5-4c3f-9bf8-a41d406f9039 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Aug 24 15:58:19.425348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1022/2069] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:19.775509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:19.777781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:19.784888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:19.785375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:19.785840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:19.786542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:19.787019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:19.787426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:19.817697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ff01623c-a1a8-4a10-afea-c4f9af4a5780 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Aug 24 15:58:19.818246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1048/2070] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:20.271561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:20.273725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:20.279649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:20.280156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:20.280595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:20.281323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:20.282400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:20.282834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:20.312572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4098f546-a6d9-4197-9de5-a4eef8ac6050 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Aug 24 15:58:20.313198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1023/2071] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:20.437186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:20.439327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:20.445574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:20.446053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:20.446489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:20.447177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:20.447651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:20.448086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:20.479087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e6dc226-f1bc-4934-98e9-18400bd4b0d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Aug 24 15:58:20.479640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1049/2072] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:20.831406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:20.833587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:20.840001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:20.840487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:20.840929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:20.841669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:20.842124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:20.842557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:20.873107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-942c89f5-1dde-4488-a344-2dfa084c292f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Aug 24 15:58:20.873680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1024/2073] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:21.325629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:21.328068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:21.334544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:21.335039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:21.335486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:21.336216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:21.336675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:21.337108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:21.367729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14c4b10e-be20-4343-99e0-dc9e1932c3ce tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046840 Aug 24 15:58:21.368289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1050/2074] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:21.492259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:21.494382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:21.502906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:21.503401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:21.503868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:21.504569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:21.505017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:21.505434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:21.538397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b2970b6-c24f-462b-9dba-4f854e5d43b9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050129 Aug 24 15:58:21.538966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1025/2075] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:21.887436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:21.891054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:21.899209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:21.899732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:21.900170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:21.900877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:21.901370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:21.901794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:21.936776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f6a5c2fb-8574-4ad7-a6be-7bda2a802660 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053480 Aug 24 15:58:21.937347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1051/2076] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:22.379291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:22.381559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:22.387511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:22.388032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:22.388470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:22.389172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:22.389622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:22.390045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:22.421335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a940977a-6fab-45ce-a1e4-a6560961c429 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Aug 24 15:58:22.421890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1026/2077] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:22.551670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:22.553789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:22.560261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:22.560746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:22.561181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:22.561876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:22.562334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:22.562760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:22.592284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd949e77-f24d-4af4-bf71-5a0fcbb7b7a0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Aug 24 15:58:22.592844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1052/2078] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:22.949533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:22.951845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:22.958766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:22.959244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:22.959708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:22.960496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:22.960951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:22.961371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:22.993343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f41e6260-87ee-4c5d-be35-25ee9cf8b862 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047872 Aug 24 15:58:22.993907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1027/2079] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:23.433299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:23.435508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:23.441706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:23.442193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:23.442634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:23.443342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:23.443822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:23.444255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:23.474891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5e5161c0-d5e3-49fe-9946-f7c6fee3767b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Aug 24 15:58:23.475394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1053/2080] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:23.604498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:23.606642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:23.612594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:23.613087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:23.613505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:23.614188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:23.614636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:23.615056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:23.645009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-43df0d6d-4cac-4d97-9a89-1b2cf17759eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Aug 24 15:58:23.645571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1028/2081] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:24.006331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:24.008508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:24.014937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:24.015420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:24.015895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:24.017200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:24.017661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:24.018095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:24.048468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c836cb8d-7ba8-46b9-9c4e-748c0fd8dd2f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Aug 24 15:58:24.049052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1054/2082] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:24.487110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:24.489337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:24.496017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:24.496504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:24.496937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:24.497676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:24.498251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:24.498805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:24.530725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-06b7c8c9-477e-4eda-8b6a-c69b14de4357 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047454 Aug 24 15:58:24.531277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1029/2083] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:24.657134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:24.659246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:24.665376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:24.665867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:24.666303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:24.667030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:24.667483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:24.667944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:24.698211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-afc2db8e-d12a-4ab8-9a70-9a54dea4ab22 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Aug 24 15:58:24.698779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1055/2084] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:25.061210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:25.063602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:25.070017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:25.070495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:25.070930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:25.071617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:25.072091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:25.072502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:25.103285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1dcddea4-4a21-4252-8d8e-7fd88f700b56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Aug 24 15:58:25.103877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1030/2085] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:25.542610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:25.544811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:25.552434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:25.552926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:25.553366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:25.554073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:25.554538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:25.554970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:25.586647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-73bde9be-e67e-4bab-ae2c-f241166c1473 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047989 Aug 24 15:58:25.587211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1056/2086] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:25.710375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:25.712626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:25.720638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:25.721173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:25.721643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:25.722350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:25.722806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:25.723263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:25.753144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f1a1e66-1ba6-4c06-a570-9de559160fb5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Aug 24 15:58:25.753707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1031/2087] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:26.116020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:26.118135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:26.124068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:26.124556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:26.124996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:26.126325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:26.126761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:26.127500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:26.161123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c836e90f-4c50-491e-b753-84e418b1df10 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049170 Aug 24 15:58:26.161699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1057/2088] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:26.599139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:26.601291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:26.607502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:26.608022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:26.608451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:26.609173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:26.609681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:26.610747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:26.642014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-760399a5-02b3-4a8b-9d34-c1da354a8b5c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Aug 24 15:58:26.642582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1032/2089] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:26.764515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:26.767351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:26.773834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:26.774315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:26.774751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:26.775462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:26.775929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:26.776358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:26.807179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3c1dda2a-3435-4543-a7b4-500a09644d32 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Aug 24 15:58:26.807760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1058/2090] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:27.173347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:27.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:27.182415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:27.182909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:27.183380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:27.184114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:27.184569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:27.185002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:27.216998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c28006f1-c8a0-43a1-894d-817ce826a0c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048112 Aug 24 15:58:27.217578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1033/2091] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:27.653494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:27.655782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:27.663325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:27.663866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:27.664311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:27.665113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:27.665624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:27.665977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:27.668815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:27.697988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90182c4f-44c4-4b1f-bd41-e98d7f2cb161 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 Aug 24 15:58:27.698553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1059/2092] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:27.818966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:27.821191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:27.827281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:27.827808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:27.828246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:27.829549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:27.830021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:27.830444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:27.860772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a6629e72-158c-40e5-9a45-f45b8023e480 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Aug 24 15:58:27.861367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1034/2093] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:28.230070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:28.232244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:28.238344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:28.239347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:28.239347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:28.239976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:28.240432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:28.240858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:28.272640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e64a386-d8e2-425f-87f8-a2c6bd9cfc8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046743 Aug 24 15:58:28.273214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1060/2094] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:28.709525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:28.711685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:28.718268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:28.718748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:28.719187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:28.719921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:28.720387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:28.720807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:28.752464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-88b6227f-aa6c-43ab-b923-2530b2b6bf23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Aug 24 15:58:28.753041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1035/2095] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:28.873338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:28.875505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:28.881875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:28.882363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:28.882802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:28.883492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:28.883981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:28.884417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:28.914550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d6c6433-488f-4d9d-8b80-ef0856aafd14 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 24 15:58:28.915125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1061/2096] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:29.285178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:29.287266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:29.293259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:29.293746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:29.294211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:29.294975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:29.295433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:29.295890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:29.325062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bd0635d6-9202-445e-8cce-c0f5152bc677 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Aug 24 15:58:29.325623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1036/2097] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:29.764173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:29.766379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:29.773221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:29.773757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:29.774178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:29.774870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:29.775328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:29.775800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:29.814116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-365e7227-e7b3-4ec4-83d7-989452eef573 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053162 Aug 24 15:58:29.815052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1062/2098] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:29.926870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:29.929155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:29.935503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:29.936022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:29.936461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:29.937155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:29.937607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:29.938039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:29.941081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:29.969000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-842be051-3ce0-4b23-8d97-b5ab0ae92576 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046561 Aug 24 15:58:29.969564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1037/2099] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:30.338167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:30.340328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:30.348042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:30.348436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:30.348883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:30.349511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:30.349964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:30.350392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:30.381002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-07c4f6c2-b0c0-4c19-baf4-0c34873e2271 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046578 Aug 24 15:58:30.381658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1063/2100] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:30.826537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:30.828751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:30.836481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:30.836975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:30.837428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:30.838138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:30.838603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:30.839371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:30.878153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-95710cc3-e438-4c21-bf91-92fe17f3980d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055392 Aug 24 15:58:30.878726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1038/2101] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:30.981774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:30.983933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:30.990393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:30.990874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:30.991308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:30.992047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:30.992503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:30.992963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:31.022436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-612f5f54-27f1-4536-9173-171310014dcc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Aug 24 15:58:31.022984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1064/2102] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:31.393486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:31.395613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:31.402387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:31.402712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:31.403152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:31.403904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:31.404400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:31.404830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:31.437702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a253d220-d6df-47c8-ba07-4e2b99933980 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048438 Aug 24 15:58:31.438307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1039/2103] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:31.891138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:31.893537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:31.900707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:31.901191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:31.901627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:31.902317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:31.902772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:31.903196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:31.934674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cce1ac1b-274d-4e1b-9ec0-c420d5869927 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047509 Aug 24 15:58:31.935301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1065/2104] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:32.034983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:32.037156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:32.043028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:32.043507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:32.043986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:32.044675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:32.045120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:32.045537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:32.074684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c37f78c-738d-4029-a5f9-81ea954749dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Aug 24 15:58:32.075232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1040/2105] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:32.451050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:32.453215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:32.460810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:32.461223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:32.461655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:32.462333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:32.462794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:32.463222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:32.495705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c79c6bb-2afb-4a9c-8e1e-ee519522d7a7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048575 Aug 24 15:58:32.496290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1066/2106] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:32.947086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:32.949257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:32.956146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:32.956623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:32.957049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:32.957738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:32.958178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:32.958598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:32.989013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-40298a09-6f97-418e-86aa-d4aa8f4df6ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Aug 24 15:58:32.994644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1041/2107] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:33.086942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:33.089158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:33.097153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:33.097700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:33.098155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:33.098871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:33.099332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:33.099833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:33.130220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7727caa4-32a1-4ed3-bdf7-0f6252401b0f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047182 Aug 24 15:58:33.130788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1067/2108] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:33.508708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:33.510850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:33.517761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:33.518127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:33.518571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:33.519274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:33.519763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:33.520193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:33.549947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-733d21f5-6352-4af2-b029-7ddd5e8d55f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 Aug 24 15:58:33.550511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1042/2109] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:33.572341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:58:33.572597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 15:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:58:34.069573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:34.071765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:34.077649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:34.078144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:34.078588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:34.079383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:34.080917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:34.081366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:34.113098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e33f605-9fe6-4e06-b5f3-7f86cb6566ff tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114403 Aug 24 15:58:34.113726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1068/2110] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:34.143806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:34.145966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:34.152743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:34.153226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:34.153662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:34.154361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:34.154819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:34.155256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:34.186179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a689de9-97bd-4a67-b7f9-a6a943c6f987 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Aug 24 15:58:34.186726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1043/2111] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:34.562424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:34.565534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:34.572271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:34.572779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:34.573311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:34.574013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:34.574500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:34.574928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:34.606148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-76e14a7b-0566-4b59-960b-99e050dc2b4a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047920 Aug 24 15:58:34.606795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1069/2112] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:35.125254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:35.127912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:35.133807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:35.134329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:35.134698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:35.135391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:35.135859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:35.136278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:35.168386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1cf87e2d-b541-4e17-b2c8-f0a0bc873aab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Aug 24 15:58:35.169154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1044/2113] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:35.198283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:35.200462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:35.206920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:35.207405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:35.207879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:35.208582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:35.209041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:35.209469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:35.240883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ee4f547c-55f6-41fe-82a7-1cd9f5c5f5b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Aug 24 15:58:35.241447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1070/2114] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:35.619149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:35.621326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:35.627830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:35.628319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:35.628767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:35.629465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:35.629923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:35.630349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:35.660675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c6d84513-ac76-40ab-86d0-2445b3f80952 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Aug 24 15:58:35.661257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1045/2115] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:36.181073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:36.183212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:36.189912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:36.190397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:36.190837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:36.191543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:36.192046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:36.192476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:36.226888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ac4a01bf-75b4-4056-a0fd-5249d5cc1113 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049715 Aug 24 15:58:36.227743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1071/2116] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:36.254156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:36.256322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:36.262805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:36.263295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:36.263762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:36.264456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:36.264910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:36.265335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:36.295540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ab541870-1708-4ffc-9f51-96f0ad3c8bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Aug 24 15:58:36.296116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1046/2117] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:36.672717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:36.675105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:36.681027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:36.681493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:36.681924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:36.682619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:36.683074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:36.683503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:36.714127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-11932e87-10c3-45c8-b319-024a018d137e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Aug 24 15:58:36.714750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1072/2118] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:37.239508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:37.241718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:37.247572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:37.248110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:37.248536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:37.249226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:37.249676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:37.250097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:37.288241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-658169da-6e3c-4db1-b430-d454f4c74b0a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052573 Aug 24 15:58:37.288922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1047/2119] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:37.309078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:37.311273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:37.318699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:37.319263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:37.319804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:37.320572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:37.321111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:37.321610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:37.351470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b58efeb-3e4b-4eaa-a0e2-4ed0877bc85e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Aug 24 15:58:37.352060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1073/2120] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:37.725459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:37.727654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:37.734217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:37.734697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:37.735130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:37.736618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:37.737070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:37.737495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:37.767655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-97ac2f73-e629-4ab4-93ce-1aaffce22662 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Aug 24 15:58:37.768427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1048/2121] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:38.299700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:38.302132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:38.309030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:38.309538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:38.310212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:38.310643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:38.311097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:38.311513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:38.344119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-15270db1-b2be-46a9-a68e-ca7a727e7e00 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048469 Aug 24 15:58:38.345535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1074/2122] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:38.363907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:38.366141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:38.372952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:38.373511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:38.374008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:38.374760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:38.375213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:38.375651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:38.405106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ee7ad46b-3bea-4f8e-8a9c-a9baa6be3926 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Aug 24 15:58:38.405660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1049/2123] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:38.780107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:38.782291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:38.788271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:38.788762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:38.789206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:38.789907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:38.790366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:38.790798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:38.815952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:38.821858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-82494de3-a857-47aa-b793-aea0dea782af tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045954 Aug 24 15:58:38.822435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1075/2124] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:39.357129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:39.359250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:39.363374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=86 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:39.367233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:39.367876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:39.368181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:39.368880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:39.369338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:39.369766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:39.401545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-950b8dc8-cd2d-495e-bdfd-0e7b3f54f4df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Aug 24 15:58:39.402118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1050/2125] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:39.418335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:39.420524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:39.428253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:39.428749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:39.429192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:39.429894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:39.430352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:39.430779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:39.461437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14c85f95-4b0d-4a1e-86bf-9161677a7db0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Aug 24 15:58:39.462010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1076/2126] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:39.833751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:39.835999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:39.841873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:39.842353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:39.842852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:39.843545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:39.844060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:39.844478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:39.875259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bf7d864c-802f-466a-b46c-62bb34070dac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Aug 24 15:58:39.875853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1051/2127] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:40.413833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:40.416058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:40.417933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=86 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:40.423883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:40.424509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:40.424778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:40.425473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:40.425924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:40.426341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:40.457331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-315dda3e-f3c3-4123-88ba-2962ec3cdc3f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047308 Aug 24 15:58:40.457896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1077/2128] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:40.473134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:40.475266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:40.482048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:40.482525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:40.482992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:40.483711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:40.484168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:40.484594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:40.515197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e9c3ecaf-4185-4d21-b4a2-d0bc1461b835 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 Aug 24 15:58:40.515783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1052/2129] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:40.887651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:40.889909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:40.896519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:40.897011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:40.897456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:40.898165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:40.898629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:40.899060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:40.929421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d3f0911-9d9a-40f9-ab40-ef41e4fed878 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Aug 24 15:58:40.930060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1078/2130] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:41.468742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:41.471498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:41.477432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:41.478021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:41.478335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:41.479289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:41.479768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:41.480195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:41.504343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:41.511097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d59930e4-d201-4767-b864-010813f370c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046292 Aug 24 15:58:41.511910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1053/2131] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:41.527451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:41.529610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:41.536790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:41.537269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:41.537701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:41.538382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:41.538828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:41.539247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:41.568807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc83e363-77eb-49ac-bee5-9faed78b542b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Aug 24 15:58:41.569550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1079/2132] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:41.942304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:41.944506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:41.951914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:41.952393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:41.952820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:41.953513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:41.953958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:41.954472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:41.984013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2f49ce0-b6ee-4929-a56a-b2992a235ec3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Aug 24 15:58:41.984558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1054/2133] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:42.523530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:42.525996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:42.531925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:42.533090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:42.533409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:42.534103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:42.534559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:42.534988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:42.566106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-15bcc624-9fcb-4cc5-8db1-c661ba81c7f5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Aug 24 15:58:42.566687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1080/2134] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:42.580795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:42.582950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:42.589427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:42.589903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:42.590336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:42.591108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:42.591468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:42.591917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:42.621225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-925640be-e4c8-4972-97bc-e5e164e9c21b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Aug 24 15:58:42.621764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1055/2135] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:42.996157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:42.998309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:43.004934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:43.004934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:43.005338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:43.006037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:43.006495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:43.006918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:43.038351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e466e41e-5d13-4549-963b-a2161fe54fb2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046103 Aug 24 15:58:43.038918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1081/2136] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:43.580365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:43.582516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:43.588805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:43.589283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:43.589717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:43.590450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:43.590838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:43.591256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:43.624276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dff2d6d2-23dc-49cb-abab-1a877f8a25cb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047942 Aug 24 15:58:43.624835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1056/2137] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:43.634633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:43.636800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:43.643912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:43.644401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:43.644840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:43.645537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:43.645999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:43.646429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:43.676480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9681a14f-97f8-4ebb-a118-b1fcd5c9480d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 Aug 24 15:58:43.677051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1082/2138] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:44.052091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:44.054422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:44.060427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:44.061194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:44.061648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:44.062356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:44.062813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:44.063239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:44.097372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9712f2fb-870d-43d2-8dae-559a2537aa75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050255 Aug 24 15:58:44.097925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1057/2139] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:44.119728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:58:44.119873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 15:58:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:58:44.636770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:44.638897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:44.646021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:44.646505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:44.646938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:44.647649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:44.648104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:44.648524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:44.678937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c8bc4bdc-3d68-4c9b-b9fc-ba8abe54c9c7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046162 Aug 24 15:58:44.679500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1083/2140] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:44.689605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:44.691948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:44.698339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:44.698846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:44.699278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:44.700007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:44.700454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:44.700877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:44.731486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f8ca38ad-574e-4b8c-a9b4-5339d8fdb08d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Aug 24 15:58:44.732069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1058/2141] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:45.109707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:45.113379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:45.119437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:45.119969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:45.120417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:45.121119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:45.121581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:45.122003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:45.153162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2c97e6b7-60bc-4f49-afe4-8cea77d57e80 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047319 Aug 24 15:58:45.153719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1084/2142] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:45.548083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:58:45.548382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 15:58:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:58:45.691764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:45.693938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:45.700521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:45.700997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:45.701430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:45.702120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:45.702566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:45.703016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:45.735483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-98ea3fbd-51e7-49be-9f4a-8490cebdcf7b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047789 Aug 24 15:58:45.736210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1059/2143] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:45.747395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:45.749642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:45.756615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:45.757321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:45.757548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:45.758249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:45.758708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:45.759147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:45.790294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3f7e2aa5-a4ac-4388-9d11-4f174fbc2baf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046901 Aug 24 15:58:45.790855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1085/2144] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:46.164980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:46.167176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:46.173152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:46.173793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:46.174479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:46.175187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:46.175667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:46.176095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:46.206320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e71009da-3b0b-4e54-9722-531540ead20b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Aug 24 15:58:46.206881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1060/2145] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:46.747482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:58:46.749723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:46.757461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:46.758351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:46.758798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:46.759500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:46.759996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:46.760426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:46.787331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [6b010b07-49f2-4ba2-9c6e-9e736b0575bb] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 15:58:46.803153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:46.805364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:46.811919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:46.812409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:46.812854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:46.813568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:46.814211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:46.814759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:46.844758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b5b62f78-1fe6-40f6-81cc-ff14ae374a27 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Aug 24 15:58:46.845965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1061/2146] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:47.218145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:47.220958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:47.226675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:47.227166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:47.227579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:47.228291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:47.228765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:47.229186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:47.263938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4aa36437-5e4a-4eb3-a03b-a62f6befe4c7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049604 Aug 24 15:58:47.264505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1062/2147] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:47.795199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [6b010b07-49f2-4ba2-9c6e-9e736b0575bb] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 34270. Aug 24 15:58:47.857868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:47.860052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:47.868005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:47.868496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:47.868934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:47.869345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fe3ea9b8-3084-48b1-a929-1e0720d72831 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/action" status: 200 len: 41126 microversion: 2.1 time: 1.125712 Aug 24 15:58:47.869640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:47.875729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:47.875729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:47.876014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1086/2148] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:58:46 2022] POST /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0/action => generated 41126 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:58:47.901867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01fd0f32-5b42-4013-8a57-423e39258072 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048122 Aug 24 15:58:47.902427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1063/2149] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:48.277575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:48.279874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:48.287515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:48.288033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:48.288468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:48.289161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:48.289615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:48.290035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:48.326300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a71861b5-d743-4701-a58a-ad9ecbf473d5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052901 Aug 24 15:58:48.326929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1087/2150] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:48.915230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:48.917410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:48.923992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:48.924591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:48.924821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:48.925524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:48.925975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:48.926398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:48.957711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-93595fb5-2288-4aee-b7ac-24a86b0d886a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046392 Aug 24 15:58:48.958289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1064/2151] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:49.338515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:49.340753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:49.348048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:49.348538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:49.348978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:49.349674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:49.350140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:49.350559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:49.380356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63bed9c7-a31f-4fdc-b70b-645ece1fcba1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Aug 24 15:58:49.380908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1088/2152] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:49.969967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:49.972760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:49.979127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:49.980037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:49.980316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:49.981012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:49.981465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:49.981883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:50.011941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc22ddc2-eb9c-4ac6-b056-b01d9863af02 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Aug 24 15:58:50.012504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1065/2153] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:50.392319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:50.395858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:50.402313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:50.402797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:50.403235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:50.403973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:50.404432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:50.404860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:50.437899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d265852-55ec-41b0-a1f0-831457fe9535 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049381 Aug 24 15:58:50.438453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1089/2154] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:51.024986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:51.027139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:51.033114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:51.033661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:51.034100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:51.034801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:51.035251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:51.035699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:51.066283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-25b703dc-e07d-4119-99d3-b1fb7b44fb5d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 24 15:58:51.067133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1066/2155] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:51.453665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:51.456501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:51.463201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:51.463731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:51.464177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:51.464880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:51.465350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:51.465777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:51.499682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6326393d-ee53-4abc-b6ec-797743e95b9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049910 Aug 24 15:58:51.500243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1090/2156] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:52.078501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:52.081760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:52.088388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:52.088910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:52.089346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:52.090045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:52.090497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:52.090964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:52.121425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a6d3e323-4856-44a5-868b-36ad2bed30b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Aug 24 15:58:52.121979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1067/2157] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:52.513436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:52.515696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:52.523139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:52.523467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:52.527819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:52.527819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:52.527819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:52.527819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:52.555379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-611bd69d-3f57-417d-bc3c-63e2089e043b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Aug 24 15:58:52.555970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1091/2158] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:53.133869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:53.136034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:53.142414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:53.143405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:53.144250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:53.144641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:53.145116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:53.145566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:53.176499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-799d498f-816a-42eb-8be7-e95129153893 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046537 Aug 24 15:58:53.177065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1068/2159] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:53.568876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:53.571049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:53.577530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:53.578021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:53.578461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:53.579162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:53.579625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:53.580069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:53.606699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:53.612703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7c98a9aa-4c31-4a0f-8cf1-47b8d5f12ad9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048364 Aug 24 15:58:53.613279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1092/2160] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:54.188584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:54.190777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:54.197134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:54.197613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:54.198042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:54.198733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:54.199180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:54.199594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:54.230917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aed58a0b-6261-43cb-ace5-c7c7f8f10f5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Aug 24 15:58:54.231460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1069/2161] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:54.626159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:54.629038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:54.635401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:54.635928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:54.636364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:54.637086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:54.637543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:54.637976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:54.667275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-60e1ab37-9edf-43b9-921b-5c0862b19eab tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046163 Aug 24 15:58:54.667862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1093/2162] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:55.243958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:55.246140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:55.252744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:55.253232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:55.253667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:55.254396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:55.254810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:55.255235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:55.269417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:58:55.287059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7e14b0dc-5e7b-4d59-9d80-e99132eae353 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048688 Aug 24 15:58:55.287612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1070/2163] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:55.680315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:55.683518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:55.689996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:55.690626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:55.691047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:55.691763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:55.692213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:55.692632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:55.722207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b0dd97c9-9585-4886-8b2c-ca9541ed92e8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046224 Aug 24 15:58:55.722767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1094/2164] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:56.298890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:56.301990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:56.308158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:56.308639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:56.309067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:56.309763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:56.310213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:56.310631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:56.342360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-92efa6b0-a609-402e-9fb0-9eef9566c522 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Aug 24 15:58:56.342918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1071/2165] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:56.737993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:56.740386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:56.747573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:56.748109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:56.748542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:56.749336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:56.749787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:56.750205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:56.784306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-628f075f-4746-481e-91f8-9a058dbdbdc2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050226 Aug 24 15:58:56.785133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1095/2166] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:57.354705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:57.357211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:57.365746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:57.366241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:57.366681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:57.367389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:57.367875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:57.368307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:57.399772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-29f16cee-0148-4320-b077-428be4bd3125 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048880 Aug 24 15:58:57.404506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1072/2167] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:57.796906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:57.799699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:57.806636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:57.807131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:57.807567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:57.808295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:57.808747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:57.809170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:57.839809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5778f9cf-d46c-45d4-974f-1564411f76e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 Aug 24 15:58:57.840455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1096/2168] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:58.413607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:58.416805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:58.423443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:58.424117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:58.425249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:58.425970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:58.426432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:58.426866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:58.458041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb7160f3-9c59-4f18-8e64-212a76ed9de6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050532 Aug 24 15:58:58.458611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1073/2169] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:58.852830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:58.854994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:58.861625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:58.862728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:58.863159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:58.863882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:58.864339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:58.864771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:58.893183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-882baf4c-973b-4d5a-a654-26076f1d6b0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Aug 24 15:58:58.893748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1097/2170] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:59.470316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:59.473122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:59.479960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:59.480753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:59.481229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:59.481931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:59.482389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:59.482817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:59.513146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7dadaeab-79ae-4549-b3bd-0c93c255f667 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Aug 24 15:58:59.513730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1074/2171] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:58:59.905498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:58:59.907683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:58:59.914125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:59.914609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:59.915043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:59.915762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:58:59.916242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:58:59.916672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:58:59.946627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7537735d-134a-49e3-b1a3-b926aba64372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Aug 24 15:58:59.947297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1098/2172] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:58:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:00.525590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:00.527768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:00.535357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:00.535880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:00.536326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:00.537038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:00.537583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:00.537916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:00.569385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aaddb2f1-ce3e-432b-b106-76da13ac03f4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Aug 24 15:59:00.569972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1075/2173] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:00.959199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:00.961404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:00.967982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:00.968469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:00.968901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:00.969599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:00.970049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:00.970472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:01.000548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad4ee5b7-a8a0-42ff-8157-62f956474479 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Aug 24 15:59:01.001117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1099/2174] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:01.581832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:01.584119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:01.590316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:01.590817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:01.591218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:01.591941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:01.592385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:01.592808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:01.623169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1b8e6905-51dc-4c83-94c0-a882baa1eef1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Aug 24 15:59:01.623755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1076/2175] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:02.013385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:02.015494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:02.022031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:02.022517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:02.022952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:02.023661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:02.024134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:02.024556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:02.054429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f3813ef7-91e0-433b-932c-db64e84a9e06 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 15:59:02.054977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1100/2176] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:02.636047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:02.638215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:02.645434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:02.645920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:02.646357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:02.647056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:02.647507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:02.647959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:02.678777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6f51f5d2-c628-46c6-8642-61790804419e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Aug 24 15:59:02.679343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1077/2177] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:03.067147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:03.069339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:03.076009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:03.076485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:03.076917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:03.077604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:03.078050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:03.078469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:03.108568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4206110f-a60b-4fdd-bf0b-1fb28fc337f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 24 15:59:03.109144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1101/2178] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:03.690406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:03.692589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:03.699038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:03.699517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:03.699991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:03.700680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:03.701131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:03.701552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:03.732869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-db914e9e-16a5-4b35-b29a-5485a8f63504 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046346 Aug 24 15:59:03.733459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1078/2179] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:04.121280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:04.123374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:04.130632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:04.131112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:04.131540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:04.132246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:04.132695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:04.133112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:04.162866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14945c9f-3608-497e-943d-27fe1f38d240 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Aug 24 15:59:04.163437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1102/2180] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:59:04.745151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:04.747332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:04.754433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:04.754915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:04.755348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:04.756072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:04.756522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:04.756947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:04.789162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60b9b95d-1aa5-4f6f-b3f5-157302f1d9ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047869 Aug 24 15:59:04.789941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1079/2181] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:05.174294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:05.176606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:05.182884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:05.183368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:05.183839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:05.184525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:05.184971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:05.185389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:05.214763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5c384610-e66f-4d4b-b204-a84c928e7372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Aug 24 15:59:05.215312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1103/2182] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:05.803019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:05.805191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:05.812650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:05.813551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:05.814337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:05.815449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:05.815946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:05.816379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:05.858291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5470987b-3e15-41b4-8a78-fecf30bcd2e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060083 Aug 24 15:59:05.858881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1080/2183] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:06.227177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:06.229357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:06.236046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:06.236535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:06.236971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:06.237663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:06.238117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:06.238541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:06.267458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-133a4e11-1d2f-44f5-969b-ada29662114f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Aug 24 15:59:06.268041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1104/2184] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:06.871377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:06.873584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:06.880736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:06.881219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:06.881649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:06.882352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:06.882800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:06.883218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:06.915200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f84fb65c-6588-407a-894d-54131df045bb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047613 Aug 24 15:59:06.915805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1081/2185] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:07.280475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:07.282679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:07.289306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:07.289802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:07.290238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:07.290932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:07.291394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:07.291857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:07.320619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bac60eae-f34d-47c1-ba4e-2c7345d1bf2e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Aug 24 15:59:07.321176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1105/2186] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:07.926444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:07.928632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:07.934980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:07.935462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:07.935923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:07.936606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:07.937058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:07.937477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:07.968472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-81dcee70-ca25-4e9b-ad58-cf8088a24903 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Aug 24 15:59:07.968890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1082/2187] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:08.332577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:08.334902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:08.341300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:08.341795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:08.342256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:08.342940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:08.343388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:08.343837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:08.373056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-940c0fd2-fedc-4acb-98a1-5cb1a1d6c96e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 24 15:59:08.373602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1106/2188] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:08.981213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:08.983325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:08.990672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:08.991178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:08.991757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:08.992511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:08.993050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:08.993527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:09.023976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1cd8d2cf-02c3-4786-97ea-d2fc1f7a5491 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047003 Aug 24 15:59:09.024542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1083/2189] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:09.386101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:09.388254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:09.394553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:09.395025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:09.396246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:09.396959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:09.397407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:09.397825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:09.426149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b1fb7304-1a11-479d-9d50-3f4c15738cb9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Aug 24 15:59:09.426734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1107/2190] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:10.037110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:10.039172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:10.041601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=68 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:10.046898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:10.047386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:10.047855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:10.048703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:10.049237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:10.049755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:10.079944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-65e8d2be-8d5b-45d8-bc69-0d91812faabc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Aug 24 15:59:10.080513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1084/2191] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:10.438333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:10.440562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:10.443007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=62 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:10.447873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:10.448602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:10.449185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:10.449942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:10.450459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:10.450994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:10.482241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9bdade3e-8a01-410c-bcdf-deca382cedd9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047777 Aug 24 15:59:10.482808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1108/2192] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:11.092738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:11.094881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:11.101522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:11.101943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:11.102380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:11.103089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:11.103546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:11.103997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:11.133575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5f543d88-92ff-4e08-81db-8bbb5d7e78b3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Aug 24 15:59:11.134124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1085/2193] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:11.495125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:11.498282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:11.504806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:11.505291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:11.505728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:11.506423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:11.506879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:11.507306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:11.521893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:11.538171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d08fbe7a-b790-4a8e-aced-9a5c49553630 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047053 Aug 24 15:59:11.538725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1109/2194] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:59:12.146451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:12.148576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:12.155139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:12.155624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:12.156367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:12.157064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:12.157519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:12.157947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:12.187190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1fad8947-f352-4597-8ce0-077ca7e2c2e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Aug 24 15:59:12.187774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1086/2195] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:12.550591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:12.552763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:12.560463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:12.561315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:12.561829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:12.562551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:12.563326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:12.563895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:12.599836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-74922a85-419e-4451-aff8-675acf08d3fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053130 Aug 24 15:59:12.600396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1110/2196] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:13.199617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:13.201781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:13.208188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:13.208664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:13.209095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:13.209776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:13.210219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:13.210637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:13.213053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:13.241662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3045b75b-0b55-4752-af39-0db9e8d2d4ad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Aug 24 15:59:13.242218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1087/2197] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:13.611772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:13.613932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:13.620457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:13.621130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:13.621435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:13.622121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:13.622574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:13.622999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:13.651360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ecd7bbfc-06bf-4a92-bbd6-38349b08d4a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Aug 24 15:59:13.652645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1111/2198] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:14.253959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:14.256122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:14.263316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:14.263833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:14.264274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:14.264973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:14.265427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:14.265853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:14.295266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-196000c5-6f1f-4155-a4c4-06772d0db04e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Aug 24 15:59:14.295870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1088/2199] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:14.664326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:14.666474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:14.673571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:14.674064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:14.674505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:14.675201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:14.675684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:14.676243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:14.706051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8937b2ab-beca-46ee-a74d-c709a1cf777a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045575 Aug 24 15:59:14.706611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1112/2200] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:15.306978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:15.309218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:15.315509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:15.316019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:15.316453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:15.317139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:15.317587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:15.318006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:15.348455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5f0615ab-6e62-4815-aa1a-8485b52d3c84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Aug 24 15:59:15.349007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1089/2201] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:15.718355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:15.720597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:15.727237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:15.727757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:15.728199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:15.728934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:15.729391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:15.729895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:15.759560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e9884635-4980-46bf-acb6-6aa96b1f0882 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Aug 24 15:59:15.760150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1113/2202] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:16.361662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:16.363863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:16.370233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:16.370734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:16.371176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:16.371899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:16.372357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:16.372782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:16.401318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-75cd567b-2824-41d9-a2c5-3893b72428b2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Aug 24 15:59:16.402485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1090/2203] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:16.772369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:16.774757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:16.781715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:16.782204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:16.782648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:16.783341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:16.783830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:16.784266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:16.815364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-539fb10d-a7c7-4a17-90a2-d86c6f9790fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Aug 24 15:59:16.815974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1114/2204] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:17.414493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:17.416687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:17.423727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:17.424217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:17.424658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:17.425354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:17.425816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:17.426234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:17.456160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d8a49fb9-ef2b-43c1-a6d8-de74fc4546a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Aug 24 15:59:17.456713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1091/2205] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:17.828772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:17.830936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:17.837468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:17.837955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:17.838393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:17.839087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:17.839736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:17.840174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:17.869345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3781056e-9458-4ea5-b742-50da3e0da92e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Aug 24 15:59:17.869909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1115/2206] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:18.468979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:18.471156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:18.477648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:18.478137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:18.478575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:18.479265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:18.479748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:18.481158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:18.510971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0a08ec01-8d17-45f0-bacf-669d73fb54b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Aug 24 15:59:18.511797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1092/2207] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:18.881848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:18.884053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:18.890912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:18.891394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:18.891876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:18.892570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:18.893022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:18.893449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:18.922259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-15d09565-5419-4a94-82db-040029590c16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 24 15:59:18.922816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1116/2208] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:19.524146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:19.526342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:19.533718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:19.534204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:19.534645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:19.535340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:19.535830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:19.536253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:19.565925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3c4e9cf1-c572-4948-ab3e-ce269a77bf6f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 24 15:59:19.566538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1093/2209] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:19.935007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:19.937239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:19.943681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:19.944186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:19.944625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:19.945324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:19.945786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:19.946214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:19.976932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-219512a6-80a7-4901-a99a-94f3edfbd91a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Aug 24 15:59:19.977488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1117/2210] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:20.578419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:20.580668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:20.586883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:20.587351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:20.587856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:20.588568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:20.589011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:20.589490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:20.618812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6f495199-39ce-48d5-b958-91c1153f1a2d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Aug 24 15:59:20.619356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1094/2211] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:20.990051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:20.992254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:20.999651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:21.000158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:21.000596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:21.001342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:21.001804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:21.002234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:21.032904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2f45e552-a49d-4673-81d4-1be2eaabc480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046731 Aug 24 15:59:21.033470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1118/2212] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:21.631663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:21.633840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:21.640424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:21.640909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:21.641346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:21.642041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:21.642495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:21.642920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:21.672823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-deb1dec5-5419-41cf-b019-861f2a4ada57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 Aug 24 15:59:21.673374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1095/2213] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:22.045642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:22.047817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:22.054180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.054653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.055085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.055804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.056256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.056672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.085253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-051a8a53-7b36-48a0-b059-dc491242b76b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Aug 24 15:59:22.085803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1119/2214] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:22.684756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:22.686820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:22.693247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.693736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.694169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.694863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.695314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.695763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.726982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8760d269-b99b-4123-9d6e-50f7c285d805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Aug 24 15:59:22.727537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1096/2215] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:23.097567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:23.099809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:23.107175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:23.107691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:23.108129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:23.108834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:23.109413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:23.109948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:23.139888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b34944ed-d7a4-4255-8eb6-f8655e04639c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Aug 24 15:59:23.140441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1120/2216] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:23.738832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:23.741015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:23.749693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:23.750263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:23.750820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:23.751536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:23.752026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:23.752457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:23.787344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d5777e3c-2432-4699-ac5f-23cbb1a6472c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052375 Aug 24 15:59:23.788059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1097/2217] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:24.152638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:24.154832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:24.161304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.161789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.162224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.162911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.163362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.163814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.192009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a89893a-3088-4c02-8a8d-c36b7c671153 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Aug 24 15:59:24.192618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1121/2218] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:24.801659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:24.803865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:24.811014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.811489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.811945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.812667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.813111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.813528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.843399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d51fd58f-b8d2-4427-8cb5-a7c4a6ad9c43 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Aug 24 15:59:24.843984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1098/2219] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:25.204309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:25.206730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:25.213174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:25.213654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:25.214085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:25.215370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:25.215987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:25.216440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:25.246482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f4baecfb-31ca-4d87-9072-526d7d9618b6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Aug 24 15:59:25.247036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1122/2220] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:25.856180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:25.859186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:25.865773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:25.866258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:25.866698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:25.867391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:25.867882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:25.868314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:25.898982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ec874b8f-8553-4b75-807a-b4ca35eb5bbe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 24 15:59:25.899543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1099/2221] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:26.258422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:26.260729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:26.267853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:26.268334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:26.268765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:26.269446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:26.269895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:26.270311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:26.298236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9c9d58a5-a0b2-4afc-87c2-baf40a43d680 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Aug 24 15:59:26.298804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1123/2222] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:26.911517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:26.913789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:26.920852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:26.921346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:26.921781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:26.922507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:26.922933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:26.923356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:26.953868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b1d99a6-72c7-4240-8206-00660ce533ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Aug 24 15:59:26.954441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1100/2223] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:27.310630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:27.312998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:27.319080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:27.319566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:27.320044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:27.320734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:27.321187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:27.321618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:27.351292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-92f5f793-8f49-41d0-94bd-e5cb8e36720e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Aug 24 15:59:27.351923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1124/2224] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:27.966095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:27.968316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:27.974651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:27.975128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:27.975555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:27.976266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:27.976710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:27.977131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.008397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fcc552df-b8dc-4d57-8a28-2e6856e5cf52 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Aug 24 15:59:28.009659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1101/2225] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:28.364383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:28.366595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:28.373183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.373666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.374157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.374868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.375323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.375780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.405107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-01347792-ce19-47dd-bd4f-a7c43d945b90 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Aug 24 15:59:28.405656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1125/2226] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:29.020985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:29.023143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:29.029877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:29.030359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:29.030792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:29.031482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:29.031958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:29.032380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:29.061733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c3d7c729-4ee5-40ee-be13-ca6da6071518 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 24 15:59:29.062287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1102/2227] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:29.417278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:29.419657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:29.425970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:29.426440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:29.426866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:29.427568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:29.428041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:29.428464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:29.430759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:29.458432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-528ec252-2075-4b9c-af5d-93087f7bae0e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Aug 24 15:59:29.458989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1126/2228] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:30.074229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:30.076422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:30.082718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.083195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.083624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.084325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.084769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.085202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.109997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:30.114984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d455b839-a8cf-43bc-b830-60da1419436b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Aug 24 15:59:30.115546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1103/2229] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:30.470916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:30.473130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:30.479428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.479941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.480377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.481061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.481509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.482750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.510523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4eb595b0-d603-4a87-915d-4e34f9339904 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 24 15:59:30.511062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1127/2230] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:31.126645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:31.128692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:31.135242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.135749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.136186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.136874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.137327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.137751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.168284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b9bf62d-d4dd-47f7-9dbf-c4bd898aaa1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Aug 24 15:59:31.168847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1104/2231] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:31.522735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:31.525113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:31.531622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.532198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.532624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.533323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.533782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.534213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.564791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d9eb4da-8454-4fe2-b4ad-a851e07b0db4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Aug 24 15:59:31.565361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1128/2232] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:32.180924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:32.183032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:32.189469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.189942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.190366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.191043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.191488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.191937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.220757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8f1aec39-217b-4a08-aa77-7120e26c848e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Aug 24 15:59:32.221305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1105/2233] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:32.577602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:32.579755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:32.586109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.586626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.587201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.587726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.588178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.588599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.617439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a1407e68-c2b1-4adb-b9e0-f2a25e1bf817 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Aug 24 15:59:32.617952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1129/2234] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:33.233742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:33.236069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:33.242773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:33.243259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:33.243785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:33.244489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:33.244953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:33.245382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:33.275409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-128ac335-94c0-41ab-9e76-fa540460a807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Aug 24 15:59:33.276009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1106/2235] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:33.629784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:33.631999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:33.638467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:33.638952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:33.639425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:33.640435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:33.640897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:33.641339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:33.670541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2b91421c-9fca-46a6-a005-fe707da92ed7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Aug 24 15:59:33.671619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1130/2236] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:34.287477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:34.289634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:34.296145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:34.296624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:34.297063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:34.297754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:34.298208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:34.298633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:34.328833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a0c2bb0-6ac0-4f15-8742-271ab0b159e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Aug 24 15:59:34.329385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1107/2237] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:34.682387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:34.684616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:34.691678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:34.692166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:34.692602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:34.693291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:34.693774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:34.694198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:34.723601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-629e3c06-fbe0-4972-bb3c-3e0dd9b0854a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Aug 24 15:59:34.724351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1131/2238] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:35.341090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:35.343898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:35.350393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:35.350880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:35.351323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:35.352074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:35.352532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:35.352958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:35.446814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-15b147ad-5a55-41f3-bfdc-4c00bab9257e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/action" status: 200 len: 76035 microversion: 2.1 time: 0.109408 Aug 24 15:59:35.447537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1108/2239] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:59:35 2022] POST /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6/action => generated 76035 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:59:35.736938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:35.739087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:35.745513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:35.745994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:35.746427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:35.747104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:35.747551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:35.747998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:35.782915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-53542fa6-46e7-4a97-94ce-8cca9e4d1a5f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Aug 24 15:59:35.783385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1132/2240] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:36.795840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:36.798599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:36.806798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:36.807331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:36.807742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:36.808449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:36.808902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:36.809329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:36.841647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-94f83435-ed08-4634-931c-8c5b595dd854 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050307 Aug 24 15:59:36.842221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1109/2241] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:37.854497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:37.856696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:37.864161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:37.864653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:37.865091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:37.865786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:37.866243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:37.866675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:37.895455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-57113469-7a28-4f4e-9fba-d4f177f520f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Aug 24 15:59:37.896039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1133/2242] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:38.908596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:38.910713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:38.917086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:38.917564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:38.917992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:38.918673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:38.919115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:38.919531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:38.947933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-068df7d3-a318-4041-b73f-fd237daba7f6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Aug 24 15:59:38.948497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1110/2243] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:39.960044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:39.962219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:39.969212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:39.969697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:39.970133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:39.970821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:39.971279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:39.971743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:40.001638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2f4d111c-b126-418b-adf1-20df008feaca tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Aug 24 15:59:40.002194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1134/2244] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:41.013952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:41.016914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:41.019437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=54 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:41.025116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:41.025602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:41.026041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:41.026741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:41.027198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:41.027651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:41.057326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8176eea3-201c-46a5-8dcc-ac4dd75c48eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047354 Aug 24 15:59:41.057882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1111/2245] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:59:42.070708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:42.072866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:42.075183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=54 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:42.081563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:42.082051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:42.082490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:42.083184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:42.083668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:42.084094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:42.113363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-55457259-1bb4-4ecb-b395-cf881945c01b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Aug 24 15:59:42.113913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1135/2246] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:59:43.127113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:43.129177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:43.135889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:43.136371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:43.136834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:43.137531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:43.137979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:43.138393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:43.168116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4bc72f2e-f357-4236-b954-0a101cda822a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045728 Aug 24 15:59:43.168668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1112/2247] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:44.180823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:44.183221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:44.190463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:44.190997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:44.191487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:44.192288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:44.192803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:44.193286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:44.225877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-95fe4d50-f49e-45e7-8f86-4232484da6f2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049366 Aug 24 15:59:44.226516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1136/2248] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:45.239872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:45.242167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:45.248670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:45.249201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:45.249913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:45.250614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:45.251070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:45.251498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:45.281475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f58ce9cf-8a61-4fb5-b1c0-1b1b27e387d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Aug 24 15:59:45.282173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1113/2249] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:46.293708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:46.297052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:46.303560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:46.304079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:46.304521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:46.305240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:46.305699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:46.306155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:46.336367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-686e294c-75c8-4eca-bbe9-3dc94f32f877 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Aug 24 15:59:46.336930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1137/2250] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:47.349550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:47.351609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:47.358057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:47.358945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:47.359395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:47.360118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:47.360570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:47.360994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:47.389415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6c457a46-5d19-4f2a-95a6-483a46c9cc42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Aug 24 15:59:47.390456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1114/2251] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:48.401554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:48.403732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:48.410475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:48.410875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:48.411312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:48.412029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:48.412485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:48.412912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:48.442509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0ba4dfa9-0000-4d4d-89e4-26fb40e214b0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Aug 24 15:59:48.443096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1138/2252] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:49.454842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:49.457084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:49.463731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:49.464127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:49.464545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:49.464545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:49.464745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:49.465239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:49.465683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:49.466104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:49.471999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:49.472417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:49.472854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:49.473556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:49.474016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:49.474441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:49.498802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eef6ac06-4491-4fa3-9ab6-a29d3420e476 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Aug 24 15:59:49.499465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1115/2253] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:49.653120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:59:49.729391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-accd7c1a-515e-4ce8-a987-e5d2efe11f5d tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 204 len: 0 microversion: 2.1 time: 0.268741 Aug 24 15:59:49.730207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1139/2254] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 15:59:49 2022] DELETE /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:59:49.741406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:49.742196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:49.748177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:49.748697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:49.750050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:49.750966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:49.751427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:49.751890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:49.883461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:49.892044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc0b0781-c50f-4f1e-917b-47f6f5c67674 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1676 microversion: 2.1 time: 0.156205 Aug 24 15:59:49.892612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1116/2255] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:59:49 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:59:50.512781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:50.515187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:50.521706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:50.522190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:50.522619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:50.523308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:50.523824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:50.524245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:50.556098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-539bfd37-591e-47ae-888a-39c09b165a4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047561 Aug 24 15:59:50.556672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1140/2256] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:50.913780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:50.914396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:50.921045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:50.921634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:50.922230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:50.922932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:50.923388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:50.923846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:50.993715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f7d31cf0f541f58af7d3d850af6472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3568d52e7dd45b58640c06eddc5ea44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:51.001855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eee8985a-a5b1-408a-a0d8-4d0c43313c1a tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 200 len: 1608 microversion: 2.1 time: 0.091893 Aug 24 15:59:51.003112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1117/2257] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:59:50 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 1608 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:59:51.124291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-0dd1f9f5-370f-4d40-92d3-0d9069204ba6 req-b54d9ad1-efa9-4ab7-9641-eb7ac247a246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecbec13-9cc8-431d-b58e-61f8f2a845aa", "name": "network-vif-deleted", "tag": "836ca65e-50ee-4a22-ac89-56fd03420b9b"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:51.135388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0dd1f9f5-370f-4d40-92d3-0d9069204ba6 req-b54d9ad1-efa9-4ab7-9641-eb7ac247a246 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:51.135850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0dd1f9f5-370f-4d40-92d3-0d9069204ba6 req-b54d9ad1-efa9-4ab7-9641-eb7ac247a246 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:51.136293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-0dd1f9f5-370f-4d40-92d3-0d9069204ba6 req-b54d9ad1-efa9-4ab7-9641-eb7ac247a246 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:51.141246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:51.151711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-0dd1f9f5-370f-4d40-92d3-0d9069204ba6 req-b54d9ad1-efa9-4ab7-9641-eb7ac247a246 service nova] Creating event network-vif-deleted:836ca65e-50ee-4a22-ac89-56fd03420b9b for instance aecbec13-9cc8-431d-b58e-61f8f2a845aa on hv-cinder-84932 Aug 24 15:59:51.159287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-0dd1f9f5-370f-4d40-92d3-0d9069204ba6 req-b54d9ad1-efa9-4ab7-9641-eb7ac247a246 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096838 Aug 24 15:59:51.160146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1141/2258] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 15:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:51.570880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:51.573571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:51.579836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:51.580328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:51.580792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:51.581530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:51.581981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:51.582605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:51.614612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ca9f7f67-634b-42b9-84a4-6ca97bbc6363 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Aug 24 15:59:51.615662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1118/2259] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:52.024679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:52.025306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:52.033996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:52.034488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:52.034934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:52.035623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:52.036102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:52.036527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:52.051168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] HTTP exception thrown: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Request method failure captured: Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa HTTP/1.1 Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf2xh-C1tFdiRt6FNZ5-FZgYhUh1suuo-ZiAQtKZc9vdNUJNh-ykM8-K9i9E8UsDkqPFnCLky4sQfFcRW5j83MuyvXMSfyH8Tq5arIZcIjWG6m3_iN5vpOz046PZgiKoAyLivIA4mPmk0t3vSMIi755nXyEP4OlpP5jAa7IjSAE8nc Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 15:59:52.052905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeTestJSON-206647015 Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeTestJSON-206647015-project Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 38f7d31cf0f541f58af7d3d850af6472 Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeTestJSON-206647015-project Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 15:59:52.054514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'aecbec13-9cc8-431d-b58e-61f8f2a845aa'} Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:59:52.058679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 15:59:52.060244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 15:59:52.061725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Returning 404 to user: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:59:52.061725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-200d6e1c-2f8a-4e1b-975e-5ce3a4f9b470 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 404 len: 111 microversion: 2.1 time: 0.034371 Aug 24 15:59:52.061725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1142/2260] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 15:59:52 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:59:52.066887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-451c3d9e-e229-4999-a99f-a7350f1da978 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '.version_select at 0x7fc5cc8d69d0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:52.090210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-451c3d9e-e229-4999-a99f-a7350f1da978 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-347779940" status: 202 len: 0 microversion: 2.1 time: 0.026971 Aug 24 15:59:52.090787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1119/2261] 10.222.0.102 () {58 vars in 1223 bytes} [Wed Aug 24 15:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-347779940 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:59:52.633102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:52.635304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:52.641670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:52.642176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:52.642614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:52.643313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:52.643801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:52.644231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:52.680555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c5170d85-e0a8-419d-8e3e-de82421d1bac tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051309 Aug 24 15:59:52.681123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1143/2262] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:53.692879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:53.695023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:53.701871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:53.702425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:53.702867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:53.703683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:53.704138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:53.704564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:53.733263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-17e38e02-9fc4-4f8a-a1f1-4cc781615cf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Aug 24 15:59:53.734734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1120/2263] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:54.746243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:54.748447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:54.755612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:54.756071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:54.756511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:54.757206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:54.757661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:54.758085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:54.786777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c83ddd34-f3af-4fc6-b5a4-a08b03bb0f8e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Aug 24 15:59:54.787325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1144/2264] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:55.798569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:55.800777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:55.807289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:55.807763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:55.808205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:55.808898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:55.809353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:55.809780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:55.835424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:55.841786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-02cfa86f-9a1e-4002-a054-2058206d2c34 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Aug 24 15:59:55.842622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1121/2265] 10.222.0.102 () {58 vars in 1307 bytes} [Wed Aug 24 15:59:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:56.859931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:56.859931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:56.864393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:56.864883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:56.865322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:56.866021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:56.866474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:56.866899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:56.964764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-88ee55ac-8054-4cdc-b319-f3f92a36b2b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action" status: 200 len: 83175 microversion: 2.1 time: 0.113966 Aug 24 15:59:56.965439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1145/2266] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 15:59:56 2022] POST /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/action => generated 83175 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:59:56.980353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:56.980909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:56.987722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:56.988208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:56.988646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:56.989334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:56.989792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:56.990212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:57.073006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.objects.instance [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lazy-loading 'services' on Instance uuid 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 {{(pid=132518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:59:57.137975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Request method failure captured: Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments/d8101a05-ef94-4465-b161-dd34588e455d HTTP/1.1 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkjTUcocnub8jefz_l1UqkU6f4nEbpKDvKzl3ULsxQq4bxT7ZPwm6HlpHklimT6SwMRqVTdHJBiv3RD6UuyR7GT86yL_yGHXt25yQ1U_b0lE-qrlwW4Dz0e8L2r9W3e_IqinmBEEIN2XIPJqovKHyCHP1HUMRwhrVxSiKM3bJwEzq00 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: e5d926b1275d40fc9b26912ea4bbca02 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-TestMinimumBasicScenario-2129160771 Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 15:59:57.141473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/e5d926b1275d40fc9b26912ea4bbca02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/e5d926b1275d40fc9b26912ea4bbca02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_e5d926b1275d40fc9b26912ea4bbca02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/e5d926b1275d40fc9b26912ea4bbca02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-TestMinimumBasicScenario-2129160771 Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: e5d926b1275d40fc9b26912ea4bbca02 Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2129160771 Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-TestMinimumBasicScenario-2129160771-project Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: fb26df0d1b82462bb494bd96dba4cf63 Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-TestMinimumBasicScenario-2129160771-project Aug 24 15:59:57.142941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'server_id': '729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1', 'id': 'd8101a05-ef94-4465-b161-dd34588e455d'} Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 15:59:57.143942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5188, in _detach_volume Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:59:57.145080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:57.146322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5210, in detach_volume Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5190, in _detach_volume Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:57.147370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) Aug 24 15:59:57.148600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 15:59:57.150004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c92257a-688d-4648-a4a7-a26fda7f8be6) {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:59:57.150004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-241f33cf-2e70-49eb-8133-a7786870f768 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments/d8101a05-ef94-4465-b161-dd34588e455d" status: 400 len: 269 microversion: 2.1 time: 0.167284 Aug 24 15:59:57.150004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1122/2267] 10.222.0.102 () {58 vars in 1421 bytes} [Wed Aug 24 15:59:56 2022] DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1/os-volume_attachments/d8101a05-ef94-4465-b161-dd34588e455d => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:00:23.427815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:00:23.428357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:02:04.128380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:02:04.128966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:02:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:02:05.557157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:02:05.557778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:02:21.794692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:02:21.795264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:02:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:03:39.371151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f96a7a8-589f-4312-bbdc-41c3084b6ab9] AMQP server on 10.222.0.102:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 16:03:39.371882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:39.372629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=19 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:39.377353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:39.378075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:39.385542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:39.386039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:39.386480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:39.387212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:39.387690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:39.388146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:39.416603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:03:39.499042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-afbe2147-f0b4-482c-b9da-ff3bc697e743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "DELETE /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 204 len: 0 microversion: 2.1 time: 0.129853 Aug 24 16:03:39.500612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1146/2268] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:03:39 2022] DELETE /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:03:39.509732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [480ee428-0e0f-47ab-bedb-42753959cd8a] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:03:39.510684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:39.512209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=9 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:39.518229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:39.518849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:39.527450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:39.527889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:39.528333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:39.529033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:39.529488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:39.529912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:39.793736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:39.802635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b125c8cc-f2b1-4ed3-ae30-5b8c6c3536d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.296972 Aug 24 16:03:39.803200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1123/2269] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:39 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:03:40.825775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:40.826379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:40.835677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:40.836401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:40.837011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:40.837907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:40.838664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:40.839187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:40.851359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f96a7a8-589f-4312-bbdc-41c3084b6ab9] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 37706. Aug 24 16:03:41.051796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:41.059912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b010934e-df8e-443f-b090-a10e66fb51b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.239074 Aug 24 16:03:41.060460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1147/2270] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:40 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:42.081642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:42.082255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:42.089456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:42.089944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:42.090382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:42.091084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:42.091541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:42.091993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:42.098419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] [480ee428-0e0f-47ab-bedb-42753959cd8a] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 37722. Aug 24 16:03:42.228537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:42.237807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-218b097f-89ac-4e86-828d-a76c9b07cf5f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.160737 Aug 24 16:03:42.238376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1124/2271] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:42 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:43.259742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:43.260388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:43.267234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:43.267763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:43.268202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:43.268900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:43.269354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:43.269780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:43.402348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:43.411490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f5073f4f-f848-47e1-9428-2f205f94860e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155610 Aug 24 16:03:43.412088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1148/2272] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:43 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:43.437749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:03:43.437918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:03:44.433114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:44.433727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:44.440366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:44.441046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:44.441499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:44.442206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:44.442660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:44.443089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:44.577545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:44.585658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-08fafca0-2384-480f-8089-a571adf862d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156419 Aug 24 16:03:44.586214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1125/2273] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:44 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:45.607752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:45.608303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:45.615119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:45.615596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:45.616068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:45.616750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:45.617202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:45.617623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:45.752425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:45.760626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-232fb48d-8d52-4396-8835-b8f229588a1d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156831 Aug 24 16:03:45.761176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1149/2274] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:45 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:46.782447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:46.783054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:46.789450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:46.789922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:46.790355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:46.791041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:46.791489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:46.792094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:46.924916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:46.935803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9c9355c-fdd4-4181-9cc0-e828841ec7fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157476 Aug 24 16:03:46.936197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1126/2275] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:46 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:47.570312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:47.570824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:47.577347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:47.577836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:47.578277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:47.578975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:47.579433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:47.579888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:47.605211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:03:47.690439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-47e0e095-5fe2-45b1-a255-dc1a256134c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 204 len: 0 microversion: 2.20 time: 0.123670 Aug 24 16:03:47.690952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1150/2276] 10.222.0.102 () {60 vars in 1285 bytes} [Wed Aug 24 16:03:47 2022] DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:03:47.699742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:47.700355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:47.708865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:47.709447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:47.709914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:47.710613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:47.711065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:47.711484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:47.847492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:47.856151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:47.857686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:47.858915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-69006961-1564-42c6-96ab-08051fa704f7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1804 microversion: 2.20 time: 0.163743 Aug 24 16:03:47.859514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1127/2277] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:47.957938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:47.958545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:47.965084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:47.965366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:47.965801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:47.966498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:47.966954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:47.968469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:48.104664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:48.113131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-023a2a7f-3dc0-47ea-8f0b-3d560f47ceb1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159685 Aug 24 16:03:48.113716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1151/2278] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:47 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:48.881214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:48.882460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:48.889119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:48.889814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:48.890077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:48.890899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:48.891342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:48.891809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:49.032792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:49.042925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:49.047450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:49.049072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4802af2e-c934-4dc9-9468-64c247665534 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1804 microversion: 2.20 time: 0.171718 Aug 24 16:03:49.049869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1128/2279] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:49.134778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:49.135397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:49.142333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:49.142977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:49.143258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:49.143994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:49.144449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:49.145094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:49.283383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:49.292244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-65d5ba48-394a-4124-8f15-55702abac0cd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.161265 Aug 24 16:03:49.292844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1152/2280] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:49 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:49.622755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-362c161e-3dd1-4eec-8f29-f805966ebe73 req-7219b276-a7e4-4eac-af67-228ecd2e7f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f595382-be87-4054-8542-60e6dfeba11d", "name": "network-vif-deleted", "tag": "943f3143-ac55-4d43-afc6-e5d7a7cab0df"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:03:49.660412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-362c161e-3dd1-4eec-8f29-f805966ebe73 req-7219b276-a7e4-4eac-af67-228ecd2e7f11 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:49.661325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-362c161e-3dd1-4eec-8f29-f805966ebe73 req-7219b276-a7e4-4eac-af67-228ecd2e7f11 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:49.661972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-362c161e-3dd1-4eec-8f29-f805966ebe73 req-7219b276-a7e4-4eac-af67-228ecd2e7f11 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:49.675789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-362c161e-3dd1-4eec-8f29-f805966ebe73 req-7219b276-a7e4-4eac-af67-228ecd2e7f11 service nova] Creating event network-vif-deleted:943f3143-ac55-4d43-afc6-e5d7a7cab0df for instance 4f595382-be87-4054-8542-60e6dfeba11d on hv-cinder-84932 Aug 24 16:03:49.685252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-362c161e-3dd1-4eec-8f29-f805966ebe73 req-7219b276-a7e4-4eac-af67-228ecd2e7f11 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066185 Aug 24 16:03:49.686883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1129/2281] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:03:50.072657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:50.073398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:50.081921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:50.082437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:50.082868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:50.083590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:50.084070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:50.084490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:50.149425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:50.159271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:50.160822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:50.162077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5e01c97f-851a-4574-a316-afe574c656ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093516 Aug 24 16:03:50.162638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1153/2282] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:50.316414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:50.317091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:50.323279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:50.323740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:50.324176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:50.324861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:50.325311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:50.325736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:50.467867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:50.476963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f606fe7b-deaa-462f-9d56-5cf826a084e5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.166177 Aug 24 16:03:50.477547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1130/2283] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:50 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:51.184736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:51.185268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:51.191913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:51.192434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:51.193321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:51.194254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:51.194913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:51.195535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:51.258583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:51.267759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:51.269294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:51.270440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a07260ca-90c2-40e0-ac6d-1f6121665416 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089698 Aug 24 16:03:51.270994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1154/2284] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:51.499354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:51.499901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:51.506297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:51.506791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:51.507225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:51.507951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:51.508406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:51.508832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:51.635401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:51.644316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b14a7bef-da39-438b-81fc-003950ce2f4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.149317 Aug 24 16:03:51.644879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1131/2285] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:51 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:52.293503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:52.294143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:52.300785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:52.301277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:52.301711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:52.302408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:52.302946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:52.303278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:52.368501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:52.377556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:52.379080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:52.380262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-33282a45-7680-48af-be91-081a84d2952a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090693 Aug 24 16:03:52.380817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1155/2286] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:52.665924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:52.666517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:52.673375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:52.673861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:52.674298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:52.674993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:52.675446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:52.675905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:52.805308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:52.814252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-de0f6cdf-2192-44c6-ad2d-85016afdccb6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152151 Aug 24 16:03:52.814845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1132/2287] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:52 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:53.402691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:53.403288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:53.412436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:53.412931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:53.413373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:53.414074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:53.414535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:53.414961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:53.478111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:53.487680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:53.489267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:53.490413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4b62f3e-dc87-4a18-868b-68400e4f4af7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091819 Aug 24 16:03:53.490964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1156/2288] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:53.836214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:53.836794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:53.844196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:53.844680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:53.845113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:53.845921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:53.846345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:53.846984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:53.981215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:53.989855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-341522ab-55eb-4a92-a378-b226bf7ac839 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157511 Aug 24 16:03:53.990433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1133/2289] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:53 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:54.512997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:54.513668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:54.520075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:54.520559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:54.520995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:54.521686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:54.522141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:54.522570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:54.585718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:54.596374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:54.597884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:54.599044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-704f724c-8451-457f-8164-1a45019a2c63 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089948 Aug 24 16:03:54.599600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1157/2290] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:55.010465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:55.011061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:55.017720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:55.018198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:55.018627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:55.019311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:55.019785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:55.020203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:55.149912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:55.158832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3a3c6bf1-84d8-4aaa-bd9f-babac3eb72f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152255 Aug 24 16:03:55.159431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1134/2291] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:55 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:55.624149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:55.624763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:55.631200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:55.631719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:55.632161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:55.632901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:55.633408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:55.633789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:55.698573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:55.708634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:55.710150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:55.711299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ea632eed-0d9d-4d9c-a0c7-4380c901ab23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091787 Aug 24 16:03:55.711888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1158/2292] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:56.180866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:56.181522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:56.188905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:56.189457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:56.189981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:56.190765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:56.191292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:56.191798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:56.337600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:56.347347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-97cd6b01-f5f6-49fa-b1c8-6de7b37c2c80 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.170696 Aug 24 16:03:56.347960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1135/2293] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:56 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:56.735292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:56.735950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:56.742440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:56.742923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:56.743360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:56.744104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:56.744569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:56.744992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:56.749349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:03:56.808354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:56.817134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:56.818614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:56.819782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de98315d-1ba5-462e-bb40-ba77d8d5bb05 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088731 Aug 24 16:03:56.820331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1159/2294] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:57.369976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:57.370589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:57.377212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:57.377697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:57.378135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:57.378831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:57.379286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:57.379740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:57.518515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:57.526612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c87f3ff7-2de3-47ca-b999-1b5152e316c6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.160545 Aug 24 16:03:57.527170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1136/2295] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:57.843555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:57.844178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:57.851733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:57.852230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:57.852666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:57.853369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:57.853822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:57.854243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:57.918217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:57.927561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:57.929096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:57.930253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f2a423fd-a99f-430a-9b78-3285cd5c5471 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091519 Aug 24 16:03:57.930807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1160/2296] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:58.547185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:58.547837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:58.554221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:58.554724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:58.555155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:58.555940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:58.556393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:58.556813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:58.688329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:58.696976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-41177525-803e-4861-a7c7-7571b817ecea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153686 Aug 24 16:03:58.697531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1137/2297] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:58 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:03:58.953840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:58.954412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:58.961088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:58.961574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:58.962009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:58.962732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:58.963186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:58.963611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:59.027734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:59.037021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:59.038527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:59.039748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3a125781-a33b-446c-bd58-e5aa22489dd8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090066 Aug 24 16:03:59.040310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1161/2298] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:03:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:03:59.720599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:03:59.721248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:03:59.727954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:59.728446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:59.728906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:59.729612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:03:59.730070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:03:59.730496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:03:59.867227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:03:59.875686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-20a82101-1929-43a3-a198-85a2d710b773 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.160444 Aug 24 16:03:59.876264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1138/2299] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:03:59 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:00.063378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:00.063959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:00.071350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:00.071883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:00.072310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:00.073043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:00.073500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:00.073929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:00.141214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:00.150364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:00.151898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:00.153060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a9047863-ab9b-4f45-a51e-9b942e61d5ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.094273 Aug 24 16:04:00.153624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1162/2300] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:00.896276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:00.896887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:00.903263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:00.903773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:00.904201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:00.904887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:00.905332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:00.905920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:01.054633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:01.064492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ecac4275-84e4-43bc-85b7-fe45bc510ee8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.172052 Aug 24 16:04:01.065063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1139/2301] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:00 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:01.177247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:01.177838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:01.185680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:01.186824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:01.187284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:01.188078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:01.188535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:01.188960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:01.260420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:01.270549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:01.272287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:01.273459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7469a8d7-5cad-46e5-baba-2c9c3541631f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.100518 Aug 24 16:04:01.274018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1163/2302] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:02.085348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:02.085943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:02.093281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:02.093762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:02.094199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:02.094892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:02.095345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:02.095805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:02.099886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:02.224108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:02.232167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58dbd801-cb95-4db7-a9e6-a3943cd80a91 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150671 Aug 24 16:04:02.232724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1140/2303] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:02.297481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:02.298217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:02.305675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:02.306244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:02.306779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:02.307718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:02.308248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:02.308763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:02.373893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:02.382823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:02.384366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:02.385514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-952814d0-35dd-45a3-ac9f-2b3faac98476 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092476 Aug 24 16:04:02.386066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1164/2304] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:03.254673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:03.255323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:03.261952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:03.262439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:03.262877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:03.263575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:03.264554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:03.265565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:03.397418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:03.407101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-51e46f2d-57fc-42c9-a801-0179076e118a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157412 Aug 24 16:04:03.407711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1141/2305] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:03 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:04:03.408562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:03.409170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:03.415538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:03.416057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:03.416493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:03.417192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:03.417642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:03.418068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:03.481462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:03.492468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:03.493977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:03.495165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-303f004f-9f18-4593-9e5c-5f2172b0a9fc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091506 Aug 24 16:04:03.495755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1165/2306] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:04.428796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:04.429412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:04.436423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:04.437030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:04.437484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:04.438177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:04.438629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:04.439052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:04.518658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:04.519268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:04.525785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:04.526273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:04.526706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:04.527406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:04.527896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:04.528324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:04.587202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:04.597114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-765b8e63-5570-4925-a7ce-ce29cee74a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.172130 Aug 24 16:04:04.611023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:04.611651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1142/2307] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:04.614263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:04.615803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:04.616944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7872f868-04a5-443a-94f9-4101f0785437 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.102779 Aug 24 16:04:04.617487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1166/2308] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:05.618494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:05.619086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:05.625561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:05.626042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:05.626474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:05.627158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:05.627609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:05.628059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:05.640102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:05.640708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:05.647069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:05.647545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:05.648012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:05.648846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:05.649357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:05.649784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:05.729716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:05.738656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:05.740181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:05.741320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-863b016e-b732-42ce-a6de-11abf1aeae11 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.105754 Aug 24 16:04:05.741872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1167/2309] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:05.789884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:05.798164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b179a9f5-ed1d-4831-8075-f1a25ac45dcb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.183550 Aug 24 16:04:05.798739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1143/2310] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:05 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:06.764731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:06.765350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:06.771904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:06.772398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:06.772841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:06.773540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:06.773999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:06.774428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:06.819859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:06.820448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:06.827555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:06.828066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:06.828497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:06.829190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:06.829633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:06.830051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:06.837688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:06.848187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:06.849633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:06.850777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2cfb28e7-88b7-4249-90b4-af03f97872a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090537 Aug 24 16:04:06.851328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1168/2311] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:06.963835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:06.972936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0da472e9-c747-4e25-9775-41c50037b7b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156964 Aug 24 16:04:06.973507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1144/2312] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:06 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:04:07.874523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:07.875137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:07.881773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:07.882260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:07.882710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:07.883393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:07.883886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:07.884318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:07.946247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:07.955947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:07.957478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:07.958639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a91ea11b-d813-41d0-bbc3-a7508f5a6fe2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088463 Aug 24 16:04:07.959179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1169/2313] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:07.993926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:07.994543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:08.001430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:08.001914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:08.002354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:08.003044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:08.003501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:08.003968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:08.139995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:08.148189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b66cf13f-7651-4ffb-adc3-a9376c864a66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158158 Aug 24 16:04:08.148750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1145/2314] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:07 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:08.981342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:08.981953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:08.989461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:08.989945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:08.990384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:08.991070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:08.991528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:08.991975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:09.054633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:09.063205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:09.064717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:09.065844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cac3932c-901e-4adf-894a-1133bf8e94f9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088473 Aug 24 16:04:09.066391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1170/2315] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:09.169779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:09.170416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:09.176850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:09.177331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:09.177766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:09.178456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:09.178909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:09.179371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:09.314882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:09.323120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e8223a10-30e5-49e7-b9ba-8ee62973d68b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157339 Aug 24 16:04:09.323726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1146/2316] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:09 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:10.089306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:10.089872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:10.093295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:10.099432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:10.099998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:10.100446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:10.101157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:10.101619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:10.102057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:10.164450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:10.173328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:10.175025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:10.176346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ed2b164b-b85d-4ccd-87ac-b1c38b65a8e9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091377 Aug 24 16:04:10.176981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1171/2317] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:10.345814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:10.346345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:10.348786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=49 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:10.354654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:10.355138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:10.355582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:10.356286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:10.356738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:10.357447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:10.492200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:10.500801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b110c23-a88f-4747-8bb9-15a50d535aa1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159177 Aug 24 16:04:10.501359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1147/2318] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:10 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:11.200055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:11.200732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:11.206863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:11.207354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:11.207827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:11.208525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:11.208986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:11.209419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:11.270379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:11.279485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:11.281020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:11.282163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-09669094-5574-4025-a404-8b2a2dd892c3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086225 Aug 24 16:04:11.282712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1172/2319] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:11.521831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:11.522390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:11.529360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:11.529838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:11.530268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:11.530957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:11.531401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:11.531846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:11.664526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:11.673527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c31956a-052f-4193-a711-22f09cf96822 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155611 Aug 24 16:04:11.674112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1148/2320] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:11 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:12.305355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:12.306704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:12.313706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:12.314257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:12.314742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:12.315454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:12.316556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:12.317288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:12.389005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:12.400841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:12.402362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:12.403533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d5cbdc97-6e28-4036-bf2e-2d72dc7a9f95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.102121 Aug 24 16:04:12.404119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1173/2321] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:12.696442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:12.697056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:12.702968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:12.703464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:12.703926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:12.704619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:12.705102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:12.705525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:12.842698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:12.851427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9c6de23b-8154-4f9e-9069-1a963f260bc6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159003 Aug 24 16:04:12.852015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1149/2322] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:12 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:13.435017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:13.435434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:13.442237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:13.442732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:13.443177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:13.443907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:13.444376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:13.444810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:13.508846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:13.517421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:13.519940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:13.521096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-abe667ed-75ce-4736-b4f4-5f31ce167c32 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090569 Aug 24 16:04:13.521656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1174/2323] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:13.872773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:13.873463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:13.881112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:13.881603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:13.882046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:13.882745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:13.883232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:13.883723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:14.012191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:14.021044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-98d37179-3ce6-4ab4-a9c2-8e5bdff5e611 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152061 Aug 24 16:04:14.021605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1150/2324] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:13 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:14.545048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:14.545630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:14.552925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:14.553408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:14.553841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:14.554523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:14.554974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:14.555394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:14.616126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:14.619456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:14.626080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:14.627639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:14.628933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-693c022a-581a-47af-96ef-8770571004ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087829 Aug 24 16:04:14.629539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1175/2325] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:15.043387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:15.044026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:15.050492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:15.050975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:15.051414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:15.052144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:15.052596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:15.053099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:15.182956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:15.191130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aba73a9b-62ef-4058-bb54-4d51067251c7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151650 Aug 24 16:04:15.191720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1151/2326] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:15 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:15.653267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:15.653860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:15.660577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:15.661066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:15.662195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:15.663105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:15.663715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:15.664355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:15.727560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:15.736353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:15.737846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:15.739018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ff9c2abb-e3ca-4b83-9791-6dcb3502fb94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089711 Aug 24 16:04:15.739574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1176/2327] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:16.212447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:16.213056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:16.219801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:16.220285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:16.220724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:16.221418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:16.221873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:16.222299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:16.355170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:16.363329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b3c4bf03-5f0d-4538-8532-49e6ed28a843 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154923 Aug 24 16:04:16.363928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1152/2328] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:16 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:16.762751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:16.763351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:16.770075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:16.770566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:16.771704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:16.772534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:16.772996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:16.773427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:16.837022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:16.846207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:16.847817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:16.848827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d334bc23-b4c0-4a12-836b-ab7efb0d334d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089946 Aug 24 16:04:16.849851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1177/2329] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:17.385828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:17.386423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:17.392917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:17.393407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:17.393841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:17.394531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:17.394987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:17.395415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:17.527713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:17.535768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a7c3d3cf-91a7-4450-a81c-c6e603ff5680 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153780 Aug 24 16:04:17.536327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1153/2330] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:17.870706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:17.871309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:17.877754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:17.878231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:17.878655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:17.879342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:17.879808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:17.880232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:17.941405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:17.950037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:17.951525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:17.952679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5ec5b26c-a48a-4f1d-948e-4c9a29add0e8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085855 Aug 24 16:04:17.953225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1178/2331] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:18.557421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:18.558023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:18.564680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:18.565166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:18.565604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:18.566302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:18.566763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:18.567295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:18.707220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:18.715670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b03df3fe-222d-4c4e-b3cc-a0a52b3ee80c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.162127 Aug 24 16:04:18.716229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1154/2332] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:18 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:18.976938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:18.977615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:18.984007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:18.984538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:18.984972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:18.985688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:18.986148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:18.986578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:19.047571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:19.056306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:19.057812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:19.058949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63cb3c16-b0a6-48ab-8f0f-ff272008fbbb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086639 Aug 24 16:04:19.059507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1179/2333] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:19.736848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:19.737495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:19.743927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:19.744451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:19.744856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:19.745551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:19.746006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:19.746436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:19.877554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:19.886363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a30acdd7-16bb-4743-91f6-e3bded3f3f6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153438 Aug 24 16:04:19.887025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1155/2334] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:19 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:20.082264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:20.082894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:20.091006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:20.091486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:20.091944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:20.092642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:20.093097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:20.093516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:20.156098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:20.164887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:20.166386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:20.167524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c8344028-80d6-4e80-9bf9-88b904f992ec tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089631 Aug 24 16:04:20.168233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1180/2335] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:20.908340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:20.908954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:20.915907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:20.916389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:20.916827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:20.917517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:20.917971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:20.918396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:21.049125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:21.053376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:21.059193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-87163132-7a76-429a-bad2-529d5b96f7ab tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154779 Aug 24 16:04:21.059832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1156/2336] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:20 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:21.193927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:21.194737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:21.201229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:21.201719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:21.202157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:21.202852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:21.203314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:21.203783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:21.266621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:21.276047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:21.277544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:21.278678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4c726b54-d93e-4533-978e-ffbbeb7f59eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089692 Aug 24 16:04:21.279239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1181/2337] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:22.081152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:22.081735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:22.088839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:22.089583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:22.090014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:22.090702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:22.091147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:22.091566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:22.221802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:22.230753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78551422-e199-4dc9-acbd-5995c04ea4de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153614 Aug 24 16:04:22.231461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1157/2338] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:22.301212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:22.301984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:22.308603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:22.309097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:22.309519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:22.310322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:22.310759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:22.311205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:22.373864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:22.383314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:22.384837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:22.385969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0b7e62d-48af-445c-b89c-39330b7eea8e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088614 Aug 24 16:04:22.386513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1182/2339] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:23.252926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:23.253604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:23.260629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:23.261115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:23.261551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:23.262247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:23.262702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:23.263127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:23.394041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:23.402641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-96e0ec36-79aa-4985-84e8-976bcaf3228b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153578 Aug 24 16:04:23.403208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1158/2340] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:23 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:23.409053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:23.409715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:23.416554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:23.417073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:23.417480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:23.418185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:23.418640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:23.419072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:23.484453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:23.493165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:23.494678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:23.495866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fb67ba5e-c318-495b-b510-d9e787e598fa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090794 Aug 24 16:04:23.496422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1183/2341] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:24.423405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:24.424067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:24.430473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:24.430951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:24.431382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:24.432084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:24.432530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:24.432947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:24.518341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:24.519048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:24.526439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:24.526931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:24.527371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:24.528113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:24.528583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:24.529009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:24.562001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:24.570234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4b46a100-8263-4b85-8b77-e9674a9ae00a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150596 Aug 24 16:04:24.571179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1159/2342] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:24.593537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:24.603743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:24.605327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:24.606472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c1e73442-fe64-429c-9818-95e83dba5f4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092130 Aug 24 16:04:24.607044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1184/2343] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:25.596163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:25.596795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:25.606995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:25.607854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:25.608300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:25.609013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:25.609695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:25.610440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:25.629561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:25.630259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:25.636718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:25.637202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:25.637701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:25.638423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:25.639191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:25.639748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:25.722288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:25.732978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:25.734481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:25.735694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ffcc32a0-13cd-4b2f-b5d8-10e93560e45f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.109977 Aug 24 16:04:25.736260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1185/2344] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:25.802396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:25.812404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3642293e-799f-4f64-8417-a279e8c0d63b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221177 Aug 24 16:04:25.813017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1160/2345] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:25 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:26.758504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:26.759130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:26.765582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:26.766066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:26.766500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:26.767189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:26.767656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:26.768090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:26.833444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:26.838774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:26.839672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:26.844787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:26.846343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:26.846495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:26.846835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:26.847270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:26.847876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7542f00a-369b-4c1a-a30c-bdf84cfb5926 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093848 Aug 24 16:04:26.848011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:26.848452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:26.848567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1186/2346] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:26.850365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:26.986528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:26.994830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e22c6250-8b5b-490d-81b1-19577ebb5a56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159867 Aug 24 16:04:26.995391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1161/2347] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:26 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:27.872117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:27.872718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:27.879167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:27.879672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:27.880913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:27.881612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:27.882055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:27.882476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:27.944139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:27.952761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:27.954247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:27.955371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-760019e0-dd88-4f96-8645-da28c40844ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087183 Aug 24 16:04:27.955955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1187/2348] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:28.015954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:28.016569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:28.023323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:28.023844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:28.024307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:28.025003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:28.025450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:28.025898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:28.157457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:28.167680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-26335058-3392-412a-94fe-c82fa206302b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155408 Aug 24 16:04:28.168264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1162/2349] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:28 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:28.978193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:28.978808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:28.985266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:28.985753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:28.986194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:28.986885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:28.987352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:28.987817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:29.053742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:29.062793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:29.064327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:29.065467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3180f555-ea38-4fa8-9ceb-9e989bf4dc53 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091680 Aug 24 16:04:29.066033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1188/2350] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:29.192888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:29.194176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:29.200724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:29.201238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:29.201674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:29.202372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:29.202829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:29.203275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:29.480741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:29.489039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12fb4590-e17d-42ce-a52f-9bca90b90532 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.300711 Aug 24 16:04:29.490231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1163/2351] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:29 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:04:30.095478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:30.096119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:30.103909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:30.104342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:30.104780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:30.105486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:30.105947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:30.106376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:30.170788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:30.179991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:30.181500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:30.182648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3bf35eef-6b86-4863-bd82-32f592e491a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091181 Aug 24 16:04:30.183206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1189/2352] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:30.511441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:30.512188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:30.518453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:30.518935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:30.519397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:30.520118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:30.520900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:30.521051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:30.651461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:30.659642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-69d91d08-9a18-4575-a99a-8653c271af3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152167 Aug 24 16:04:30.660220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1164/2353] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:30 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:31.205532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:31.206171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:31.213313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:31.214048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:31.214481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:31.215170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:31.215624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:31.216078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:31.286445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:31.295157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:31.296702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:31.297839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aa723d18-f495-4d2f-a8fc-54b97c8c276d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.096236 Aug 24 16:04:31.298400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1190/2354] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:31.682263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:31.682865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:31.688963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:31.689443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:31.689873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:31.690550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:31.690998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:31.691417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:31.818996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:31.827255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-855f49e6-0df6-470a-907d-933aba7c34e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.149401 Aug 24 16:04:31.827846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1165/2355] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:31 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:32.321019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:32.321744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:32.328233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:32.328742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:32.329627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:32.330329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:32.330795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:32.331224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:32.397278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:32.405924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:32.407412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:32.408564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1de65b53-b14e-4ba2-b6ce-61c62ca2adeb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091691 Aug 24 16:04:32.409124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1191/2356] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:32.848715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:32.849377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:32.855764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:32.856245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:32.856675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:32.857355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:32.857803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:32.858223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:32.985851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:32.995424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c363f1c2-f08e-43ce-ba1a-5d82667d0c4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150626 Aug 24 16:04:32.996029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1166/2357] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:32 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:33.432042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:33.432639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:33.439496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:33.440010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:33.440448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:33.441131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:33.441589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:33.442654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:33.460461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:33.505025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:33.513774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:33.515309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:33.516478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-87253e02-a0a2-4d1b-a451-9bcb5e3f9496 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088381 Aug 24 16:04:33.517035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1192/2358] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:34.017928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:34.018539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:34.026336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:34.026504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:34.026907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:34.027609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:34.028090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:34.028516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:34.161807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:34.169933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-16978804-20ff-4f86-8cfd-962bf011b41c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155902 Aug 24 16:04:34.170487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1167/2359] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:34 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:34.539821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:34.540439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:34.546586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:34.546911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:34.547500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:34.548280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:34.548829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:34.549275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:34.614249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:34.622938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:34.624463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:34.625608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-57d60250-2a4e-4b7d-83f2-a5ba0f2667d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090263 Aug 24 16:04:34.626177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1193/2360] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:35.191085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:35.192441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:35.199610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:35.200119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:35.200550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:35.201249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:35.201697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:35.202119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:35.329918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:35.338128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7d313f29-3917-4b22-832e-4746797d4b43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150966 Aug 24 16:04:35.338941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1168/2361] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:35 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:35.649705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:35.650310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:35.656800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:35.657290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:35.657732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:35.658426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:35.658899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:35.659326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:35.725229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:35.734041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:35.735522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:35.736721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-014fe473-3bd2-422d-a91c-e00df1000422 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091023 Aug 24 16:04:35.737264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1194/2362] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:36.359986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:36.361005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:36.368429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:36.368918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:36.369357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:36.370052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:36.370507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:36.370935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:36.502050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:36.510846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb7e89b4-7aec-494a-95f6-3fe15253fa78 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155148 Aug 24 16:04:36.511401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1169/2363] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:36 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:36.759490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:36.760242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:36.766656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:36.767138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:36.767576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:36.768297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:36.768754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:36.769180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:36.832034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:36.841542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:36.843086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:36.844306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f0866588-4573-443f-9860-9efbd1b3d810 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088822 Aug 24 16:04:36.844852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1195/2364] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:37.532532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:37.533143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:37.540535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:37.541027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:37.541456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:37.542173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:37.542632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:37.543057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:37.672723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:37.680879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a0a07b8-d8bd-479f-b197-84cb8926141e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152191 Aug 24 16:04:37.681440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1170/2365] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:37 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:37.866397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:37.867034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:37.873659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:37.874143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:37.874573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:37.875262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:37.875736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:37.876162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:37.944567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:37.953752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:37.955256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:37.956428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-406c4112-b6ac-49e0-a2c8-0007ccc54606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093947 Aug 24 16:04:37.957026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1196/2366] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:38.702368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:38.702975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:38.709371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:38.709848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:38.710277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:38.710957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:38.711404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:38.711857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:38.839932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:38.849514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ccc15361-d31b-4fa5-bdc5-b9311b1873fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150930 Aug 24 16:04:38.850100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1171/2367] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:38 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:38.980301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:38.980867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:38.987206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:38.987787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:38.988783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:38.989535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:38.989990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:38.990424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:39.054267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:39.063085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:39.064626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:39.065760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1a437a28-74d0-400f-a7b2-bb4bf3523b3d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089551 Aug 24 16:04:39.066315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1197/2368] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:39.870326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:39.870937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:39.877451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:39.877931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:39.878364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:39.879701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:39.880156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:39.880580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:40.014117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:40.022653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a81f1d5-6c4e-4c23-9198-68f761ed7743 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155812 Aug 24 16:04:40.022958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1172/2369] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:39 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:40.090249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:40.090864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:40.097392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:40.098094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:40.098300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:40.098993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:40.099448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:40.099894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:40.162163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:40.170613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:40.172127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:40.173254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2edaa79d-348e-43cd-b15a-5f7540add700 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088397 Aug 24 16:04:40.173798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1198/2370] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:41.043721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:41.044253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:41.046538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=52 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.052092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:41.052582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:41.053031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:41.053717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:41.054168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:41.054607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:41.073679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.190484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:41.196712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:41.197319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:41.199156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=56 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:41.199436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7ea272a5-4f21-4d38-a716-612dcd6fbfbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159795 Aug 24 16:04:41.200032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1173/2371] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:41 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:41.204972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:41.205465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:41.205901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:41.206779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:41.207940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:41.208372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:41.269468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:41.279972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:41.281494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:41.282647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c2630e98-0a82-4b38-bb8b-5f5dac154738 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090152 Aug 24 16:04:41.283211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1199/2372] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:42.222628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:42.223590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:42.229965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:42.230447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:42.230881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:42.231576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:42.232058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:42.232481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:42.305845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:42.305845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:42.313351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:42.314707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:42.314707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:42.315065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:42.316005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:42.316441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:42.392517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:42.397470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:42.402297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:42.403824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:42.404973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-91830666-d81b-4769-b7ae-f77b4ce25694 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.104419 Aug 24 16:04:42.405554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1200/2373] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:42.405723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e8da370-526e-47b7-8364-b6b794ce5f68 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.187468 Aug 24 16:04:42.406196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1174/2374] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:42 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:43.428065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:43.428774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:43.429165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:43.429273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:43.435281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:43.435453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:43.435793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:43.435923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:43.436229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:43.436376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:43.436918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:43.437035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:43.437367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:43.437483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:43.437787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:43.437894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:43.523114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:43.531991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:43.533493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:43.535127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d342f21-6f0e-4d35-badf-30388e9ebae8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.111200 Aug 24 16:04:43.535829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1201/2375] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:43.589356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:43.598598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d0c219ea-9949-43ac-92f4-b63f213fe6a3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.174961 Aug 24 16:04:43.609121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1175/2376] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:43 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:44.557701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:44.558315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:44.565367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:44.566531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:44.566974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:44.567726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:44.568208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:44.568614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:44.632027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:44.632582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:44.632992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:44.639302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:44.639899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:44.640405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:44.640651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:44.641264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:44.641861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:44.642255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:44.642402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:44.643421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d05ef36-6882-4c30-b2c1-2b62e95ed9d3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090012 Aug 24 16:04:44.644150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1202/2377] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:44.776981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:44.785461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f7d5b984-2a92-42b1-882b-fd67bb843a55 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158049 Aug 24 16:04:44.786027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1176/2378] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:44 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:04:45.666815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:45.667425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:45.673896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:45.674382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:45.674822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:45.675752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:45.676262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:45.676693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:45.740889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:45.749556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:45.751064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:45.752376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-08fec720-4f20-49a1-9cab-15913b39d10f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089660 Aug 24 16:04:45.752934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1203/2379] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:45.806403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:45.807013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:45.813412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:45.813888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:45.814318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:45.814999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:45.816005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:45.816473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:45.945075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:45.953428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ba9c5a1-0407-4409-99f4-fd3eab701886 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150884 Aug 24 16:04:45.953988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1177/2380] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:45 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:46.775003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:46.775566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:46.781904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:46.782386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:46.782820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:46.783506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:46.783988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:46.785040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:46.851862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:46.860423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:46.861902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:46.863185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b106350c-6e56-4d99-b838-f9068df99bdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092188 Aug 24 16:04:46.863754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1204/2381] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:46.976254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:46.976869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:46.983289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:46.983822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:46.984271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:46.984955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:46.985415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:46.985845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:47.121013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:47.129317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-31d4c4ea-fd92-4ea3-922b-31b0091b77fe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157757 Aug 24 16:04:47.129897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1178/2382] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:46 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:47.885269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:47.885879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:47.892376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:47.892892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:47.893327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:47.894098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:47.894579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:47.895007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:47.956363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:47.965289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:47.966802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:47.967992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-69d393a3-07bd-4383-8c8c-cb564bcdd885 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086649 Aug 24 16:04:47.968554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1205/2383] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:48.150287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:48.150920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:48.157344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:48.157825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:48.158256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:48.158934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:48.159944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:48.160369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:48.296844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:48.305573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-61486550-6dd3-4035-9905-369876788d4d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159148 Aug 24 16:04:48.306125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1179/2384] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:48 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:48.991692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:48.992309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:48.998699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:48.999183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:48.999619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:49.000326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:49.000781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:49.001203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:49.063390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:49.072168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:49.073656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:49.074809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-985b26f9-570b-4d18-b7a4-7b6aff703f70 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087741 Aug 24 16:04:49.075371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1206/2385] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:49.326451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:49.327067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:49.334619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:49.335111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:49.335553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:49.336279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:49.336741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:49.337169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:49.465664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:49.474542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fe387e0a-9f8f-4756-98ed-e9769ef29768 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151966 Aug 24 16:04:49.475100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1180/2386] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:49 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:50.098545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:50.099116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:50.105661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:50.106241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:50.106680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:50.107373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:50.107863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:50.108291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:50.174136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:50.183175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:50.184708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:50.185854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e5de456-039a-4ef1-ac23-3d350c9189c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092363 Aug 24 16:04:50.186388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1207/2387] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:50.495674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:50.496274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:50.503371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:50.503899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:50.504345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:50.505035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:50.505482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:50.505907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:50.865052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:50.873230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c26ed6e1-630a-40fe-84cc-da40bebb8af6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.381486 Aug 24 16:04:50.873790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1181/2388] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:50 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:51.209874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:51.210465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:51.217048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:51.217531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:51.217956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:51.218636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:51.219088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:51.219502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:51.279905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:51.288434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:51.289913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:51.291037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d5bcc58f-8320-4743-b33f-1e6ed3e6970c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085829 Aug 24 16:04:51.291583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1208/2389] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:51.896877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:51.897493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:51.904001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:51.904487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:51.904927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:51.905684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:51.906142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:51.906569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:52.042617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:52.051684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bfc37d5e-a7a8-435e-bef8-a0a3726ebbf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159455 Aug 24 16:04:52.052248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1182/2390] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:51 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:52.314073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:52.315047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:52.323207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:52.324253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:52.325411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:52.326618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:52.327530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:52.328275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:52.332882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:04:52.390836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:52.399522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:52.401084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:52.402223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dbd45246-1142-47e4-9307-01b0c14a33b7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092252 Aug 24 16:04:52.402777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1209/2391] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:53.072607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:53.073217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:53.079742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:53.080231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:53.081715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:53.082420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:53.082881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:53.083312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:53.217272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:53.225456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-762636b2-df1b-4a6c-b128-597ffb846cbd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156731 Aug 24 16:04:53.226013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1183/2392] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:53 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:53.425533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:53.426086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:53.432443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:53.432925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:53.433356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:53.434035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:53.434483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:53.434901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:53.500241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:53.509549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:53.511061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:53.512224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b0a48b1-61a3-48bb-8814-83d13f7eeeb2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090830 Aug 24 16:04:53.512792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1210/2393] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:54.246552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:54.247186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:54.254045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:54.254529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:54.254958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:54.255651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:54.256126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:54.256542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:54.385533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:54.394674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bcdfb00c-eb1a-4b6c-a338-ef0bf7a39260 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151751 Aug 24 16:04:54.395248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1184/2394] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:54 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:54.535997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:54.536614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:54.543263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:54.543780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:54.544216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:54.544911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:54.545367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:54.545793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:54.607398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:54.616827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:54.618337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:54.619481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b0e7895-feba-4805-b314-bfb68d86a629 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088207 Aug 24 16:04:54.620069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1211/2395] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:55.416166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:55.416764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:55.423148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:55.423661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:55.424099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:55.425610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:55.425899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:55.426331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:55.557058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:55.565884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aa25500e-4a60-4470-a0e5-290ff08c06f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153016 Aug 24 16:04:55.566450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1185/2396] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:55 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:55.643432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:55.644239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:55.650918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:55.651455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:55.651875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:55.652570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:55.653471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:55.653471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:55.714209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:55.723530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:55.725060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:55.726202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8a3a76b5-8e2f-4f31-863b-1f3b82179b3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086821 Aug 24 16:04:55.726758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1212/2397] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:56.586119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:56.586761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:56.593425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:56.593915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:56.594351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:56.595041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:56.595491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:56.595951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:56.724286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:56.732567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4f185bb5-960b-4beb-9f94-134db2ee65b9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150347 Aug 24 16:04:56.733135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1186/2398] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:56 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:56.748928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:56.749535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:56.756563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:56.757051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:56.757483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:56.758172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:56.758617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:56.759037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:56.824935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:56.834260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:56.836196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:56.837533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e4e5d23f-0809-42fb-ad0c-5a413f5d2318 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092219 Aug 24 16:04:56.838077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1213/2399] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:04:57.755317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:57.756189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:57.762447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:57.762933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:57.763538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:57.764125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:57.765087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:57.765652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:57.859704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:57.861066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:57.867779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:57.868278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:57.868723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:57.869433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:57.869901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:57.870327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:57.900533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:57.908997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-820a3603-4bb8-4c4f-af7f-d6abcc89f7e7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158580 Aug 24 16:04:57.909561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1187/2400] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:04:57.931797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:57.941385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:57.942958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:57.944181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3105e675-e573-4c65-90c2-0983629f0c06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088406 Aug 24 16:04:57.944745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1214/2401] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:58.930270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:58.930865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:58.937465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:58.937955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:58.938396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:58.939089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:58.939545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:58.940149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:58.967246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:04:58.967886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:04:58.975606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:58.976128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:58.976562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:58.977258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:04:58.977711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:04:58.978142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:04:59.057268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:59.067883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:59.069410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:59.070738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4b7e95d8-00f5-45a7-b402-5ef6fda43591 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.107401 Aug 24 16:04:59.071355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1215/2402] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:04:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:04:59.098562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:04:59.106785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d134c4a6-8e01-4fd3-b417-69a293bb4421 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.180493 Aug 24 16:04:59.107349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1188/2403] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:04:58 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:00.094237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:00.094818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:00.101925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:00.102413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:00.102846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:00.103551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:00.104040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:00.104479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:00.129080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:00.129691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:00.136491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:00.136910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:00.137349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:00.138058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:00.138513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:00.138940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:00.180959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:00.188558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:00.190726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:00.192025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-381bf9d1-3905-481e-9bd6-2396ebb92952 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101985 Aug 24 16:05:00.192586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1216/2404] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:00.281298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:00.290516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4f9fe8b3-0d49-434a-9571-4e10fe4d4ae4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.165903 Aug 24 16:05:00.291114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1189/2405] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:00 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:01.216962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:01.217578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:01.225130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:01.225642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:01.226080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:01.226816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:01.227292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:01.227750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:01.291337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:01.300135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:01.301615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:01.302742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1ae98adb-f347-4950-9290-9ba66a85e294 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089875 Aug 24 16:05:01.303296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1217/2406] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:01.312417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:01.313029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:01.319606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:01.320115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:01.320552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:01.321235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:01.321687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:01.322110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:01.326026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:01.452817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:01.463072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-53c1e346-bce7-4d64-a9ce-4305bd7f9143 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154486 Aug 24 16:05:01.463645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1190/2407] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:01 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:02.324990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:02.325615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:02.332392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:02.332878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:02.333319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:02.334015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:02.334471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:02.334898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:02.398427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:02.407172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:02.409814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:02.410960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a110f799-8f89-45f3-9ff1-84aa7dff6e80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089916 Aug 24 16:05:02.411536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1218/2408] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:02.485973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:02.487818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:02.494155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:02.494651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:02.495087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:02.495831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:02.496269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:02.496692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:02.629319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:02.637538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-893abf48-e655-4777-8ffb-415cfc8aa9fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156245 Aug 24 16:05:02.638107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1191/2409] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:03.434781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:03.435398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:03.441963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:03.442442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:03.442871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:03.443554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:03.444035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:03.444464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:03.506927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:03.515445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:03.516961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:03.518859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0cad0e17-c05c-4d44-8e2d-12bf7b162c23 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088018 Aug 24 16:05:03.519410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1219/2410] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:03.659245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:03.659987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:03.666566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:03.667049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:03.667510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:03.668232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:03.668688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:03.669119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:03.803767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:03.812061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-843a4fe4-446a-4cdb-bd1d-261125c8046a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157302 Aug 24 16:05:03.812627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1192/2411] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:03 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:04.542170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:04.542733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:04.549222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:04.549707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:04.550331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:04.550990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:04.551858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:04.552090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:04.618678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:04.627304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:04.628857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:04.630671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-96fda844-8276-4596-a10b-e78ab05f4cca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092592 Aug 24 16:05:04.631230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1220/2412] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:04.833952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:04.834483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:04.841353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:04.841837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:04.842267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:04.842956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:04.843467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:04.843852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:04.972557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:04.981050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9307787-bdc9-4ab3-bc6f-b160bf5f858b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151114 Aug 24 16:05:04.981609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1193/2413] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:05.654266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:05.654884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:05.661349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:05.661829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:05.662260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:05.664204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:05.664652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:05.665170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:05.730626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:05.739693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:05.741310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:05.743239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e0d5eb57-3160-4f52-8d70-465d43d45732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092248 Aug 24 16:05:05.745966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1221/2414] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:06.002614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:06.003182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:06.010524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:06.010995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:06.011424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:06.012131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:06.012584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:06.013004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:06.148229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:06.156479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-102e1340-f25d-4576-b6e7-d1835f05a20e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157722 Aug 24 16:05:06.157052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1194/2415] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:05 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:06.768111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:06.769254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:06.776004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:06.776501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:06.776941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:06.777656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:06.778145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:06.778573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:06.844019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:06.853171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:06.854675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:06.855850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-706b1e14-1a93-4d02-9c2e-7bb0b5153c44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092656 Aug 24 16:05:06.856408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1222/2416] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:07.178918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:07.179654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:07.186003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:07.186480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:07.186909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:07.187595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:07.188070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:07.188488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:07.320015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:07.328123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fc59a700-393c-4f6c-9bbc-e62c7849713b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153621 Aug 24 16:05:07.328675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1195/2417] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:07 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:07.879037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:07.879678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:07.886995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:07.887479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:07.887947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:07.888852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:07.889103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:07.889526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:07.955847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:07.965594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:07.967092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:07.968275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9151675a-7ccc-4a0e-85bc-c8357e7ebe6c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093148 Aug 24 16:05:07.968843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1223/2418] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:08.349691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:08.350432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:08.357505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:08.358005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:08.358446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:08.359236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:08.359830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:08.360264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:08.491954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:08.500314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-31cd2255-a1d4-4d7d-a9b3-0a4bc94fc4d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154630 Aug 24 16:05:08.500878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1196/2419] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:08 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:08.993578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:08.994195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:09.000724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:09.001221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:09.001658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:09.002357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:09.002812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:09.003257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:09.065527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:09.074780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:09.076324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:09.077482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ff86468b-394f-44ec-8d32-cb183b37f851 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088128 Aug 24 16:05:09.078059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1224/2420] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:05:09.522152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:09.522765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:09.529313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:09.529801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:09.530236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:09.530930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:09.531383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:09.531845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:09.664399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:09.673608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ef39b5b2-8658-4154-8537-5eab60b0f9ec tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155895 Aug 24 16:05:09.674191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1197/2421] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:09 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:10.102073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:10.102639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:10.109058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:10.109542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:10.109978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:10.110693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:10.111146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:10.111570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:10.174439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:10.178107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:10.184877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:10.186368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:10.187521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3c43bf4e-3d7e-4641-bc08-6ffbfdad6f98 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089716 Aug 24 16:05:10.188086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1225/2422] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:10.695464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:10.696081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:10.702459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:10.702931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:10.703358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:10.704076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:10.704520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:10.704933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:10.847974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:10.856296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aaf46ec0-61c3-4174-accf-7c656a3fbc71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.165279 Aug 24 16:05:10.856861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1198/2423] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:10 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:11.211674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:11.212277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:11.214161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=54 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:11.219388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:11.219908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:11.220346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:11.221044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:11.221514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:11.221931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:11.288845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:11.297878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:11.299372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:11.300556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-055ad2bc-a4cb-46da-a219-5dcbfa5e3bd9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093883 Aug 24 16:05:11.301117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1226/2424] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:11.879893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:11.881496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:11.884588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=52 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:11.891880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:11.892604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:11.893287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:11.894327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:11.895007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:11.895709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:12.027078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:12.035301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ff2b2ca-0359-44cb-9abf-f93322913a34 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.161222 Aug 24 16:05:12.035890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1199/2425] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:11 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:12.323032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:12.323720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:12.330358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:12.330851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:12.331291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:12.332028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:12.332494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:12.332920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:12.395996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:12.405306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:12.406824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:12.407995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-71c4a70f-0d20-4ffd-9eb2-c6cabf2cfa39 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088921 Aug 24 16:05:12.408559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1227/2426] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:13.056690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:13.057340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:13.063316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:13.063839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:13.064280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:13.065016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:13.065453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:13.065941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:13.199623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:13.207903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d2d543b2-0435-4053-8bb7-a3c2cd0388e8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155378 Aug 24 16:05:13.208468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1200/2427] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:13 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:13.431855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:13.432378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:13.439122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:13.439608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:13.440082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:13.440797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:13.441250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:13.441673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:13.502969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:13.514293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:13.515919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:13.518089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2dba10f1-d0a0-46e3-b590-5bffc10021bd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090568 Aug 24 16:05:13.519083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1228/2428] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:13.584873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:05:13.585130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:05:14.230029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:14.230717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:14.238841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:14.239356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:14.239842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:14.240553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:14.241002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:14.241425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:14.374505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:14.383450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-edadc4a2-ee85-44c9-a9eb-cc7a68b38720 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157324 Aug 24 16:05:14.384056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1201/2429] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:14 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:14.543496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:14.544062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:14.550499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:14.550985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:14.551423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:14.552149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:14.552649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:14.553075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:14.619458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:14.628097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:14.629607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:14.631428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-82ccadb0-886c-4616-bc60-a416f6543c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091764 Aug 24 16:05:14.632022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1229/2430] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:15.405175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:15.405773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:15.412339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:15.412813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:15.413244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:15.413924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:15.414371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:15.414789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:15.548981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:15.558045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2aff59e7-57fa-4f94-b145-63713c2df846 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156765 Aug 24 16:05:15.558604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1202/2431] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:15 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:15.653558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:15.654170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:15.660671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:15.661189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:15.662224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:15.663094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:15.663560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:15.664008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:15.727439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:15.736169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:15.737675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:15.738817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-037360c2-1139-464c-8f04-09e9f957ac13 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089257 Aug 24 16:05:15.739386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1230/2432] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:05:16.579600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:16.580254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:16.587368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:16.587902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:16.588335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:16.589052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:16.589508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:16.589935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:16.724915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:16.733258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-76d51f6e-5214-45a4-840f-4cc14a25e579 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157510 Aug 24 16:05:16.733828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1203/2433] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:16 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:16.761590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:16.762178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:16.769201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:16.769683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:16.770112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:16.770828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:16.771489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:16.772024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:16.833823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:16.842889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:16.844418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:16.845570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3130320f-5dba-4a12-8a31-59a62435744d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087885 Aug 24 16:05:16.846331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1231/2434] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:17.755402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:17.756063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:17.762358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:17.762838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:17.763271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:17.764013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:17.764458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:17.764872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:17.869287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:17.869983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:17.876645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:17.877218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:17.878053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:17.878273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:17.878732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:17.879161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:17.898568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:17.906877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f7ebf5b-7fff-40b6-b559-d6a54efdd4e1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155718 Aug 24 16:05:17.907690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1204/2435] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:17.949697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:17.959007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:17.960585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:17.962008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-888df5c9-7506-4f76-81e3-d45cdee3d1b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097364 Aug 24 16:05:17.962590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1232/2436] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:18.929415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:18.930028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:18.936672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:18.937180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:18.937623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:18.938313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:18.938768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:18.939194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:18.985526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:18.986252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:18.992839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:18.993394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:18.993900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:18.994673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:18.995132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:18.995559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:19.068928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:19.077546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:19.079048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:19.080240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f8546530-3008-4f02-a306-66f7b5ad9b92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098619 Aug 24 16:05:19.081076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1233/2437] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:05:19.097674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:19.105815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-46ac3b17-7213-4415-9ad7-9df9d89da037 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.180804 Aug 24 16:05:19.106530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1205/2438] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:18 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:20.104251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:20.104809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:20.111291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:20.111822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:20.112270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:20.112959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:20.113419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:20.113847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:20.127223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:20.127899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:20.134023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:20.134500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:20.134933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:20.135643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:20.136096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:20.136519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:20.181250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:20.190699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:20.192400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:20.194108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-81a3d91d-7446-450f-a7e6-81916b1fe465 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093772 Aug 24 16:05:20.194778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1234/2439] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:20.276011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:20.279349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:20.284844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6240db0-4b39-4eb2-b8d9-2eacf1714cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.161340 Aug 24 16:05:20.285403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1206/2440] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:20 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:21.217835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:21.218433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:21.226052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:21.226545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:21.226983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:21.227708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:21.228169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:21.228600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:21.290933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:21.299571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:21.301190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:21.302516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0c9b7fbb-d41b-440e-bc39-17caee9f260e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088689 Aug 24 16:05:21.303068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1235/2441] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:21.306501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:21.307110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:21.313382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:21.313855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:21.314291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:21.314974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:21.315425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:21.315883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:21.445523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:21.453640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f72ba7f-b11a-471e-b635-10e730f1fdf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151256 Aug 24 16:05:21.454195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1207/2442] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:21 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:22.324704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:22.325326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:22.331830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:22.332323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:22.333028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:22.333833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:22.334296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:22.334727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:22.402070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:22.413290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:22.414802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:22.416028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f3eca56f-6822-42d1-807c-a89bc6d1d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095200 Aug 24 16:05:22.416531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1236/2443] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:22.484255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:22.484911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:22.491521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:22.492114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:22.492553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:22.493255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:22.493707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:22.494133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:22.622914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:22.631267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-23f792f1-eb1b-4799-baf7-61fad6046580 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.160130 Aug 24 16:05:22.631864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1208/2444] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:23.438964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:23.439568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:23.446648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:23.447354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:23.447854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:23.448573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:23.449035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:23.449468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:23.516262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:23.525618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:23.527094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:23.528255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b7756af-3023-4062-a546-553d1da8b7aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093205 Aug 24 16:05:23.528811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1237/2445] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:23.652417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:23.653020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:23.659460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:23.659974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:23.660403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:23.661224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:23.661722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:23.662149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:23.798462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:23.806655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-18855a85-b75e-4161-bde0-9d1c11980a29 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158088 Aug 24 16:05:23.807219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1209/2446] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:23 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:24.137986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:05:24.138271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:05:24.550766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:24.551444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:24.557818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:24.558297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:24.558731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:24.559404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:24.559893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:24.560314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:24.622218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:24.631463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:24.633003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:24.634138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-024157a9-cf59-46a6-a499-00abdcb36bac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087430 Aug 24 16:05:24.634694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1238/2447] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:24.828666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:24.829201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:24.836215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:24.836701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:24.837133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:24.837824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:24.838274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:24.838702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:24.970155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:24.979717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-442ecf20-478e-40fd-9feb-0836fe4d09d2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154919 Aug 24 16:05:24.980300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1210/2448] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:25.565348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:05:25.565555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:05:25.656606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:25.657253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:25.664755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:25.665251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:25.665709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:25.666386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:25.666842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:25.667269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:25.732112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:25.741727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:25.743215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:25.744392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-70243e7c-e323-404a-a83b-4edaf1156da6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091761 Aug 24 16:05:25.745065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1239/2449] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:26.002175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:26.002743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:26.012111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:26.012971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:26.013423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:26.014137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:26.014594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:26.015024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:26.145018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:26.153368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5d1df588-8de8-40b6-9414-308913943ebe tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155217 Aug 24 16:05:26.153922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1211/2450] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:25 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:26.767586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:26.768219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:26.777254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:26.777747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:26.778188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:26.779360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:26.779860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:26.780292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:26.857492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:26.867541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:26.869063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:26.870196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b93ca03c-bafa-4eaa-be8c-631af22e261d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.106546 Aug 24 16:05:26.870845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1240/2451] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:27.175166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:27.175794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:27.182867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:27.183342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:27.183805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:27.184491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:27.184937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:27.185360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:27.333993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:27.342514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f639789e-b001-4119-ad13-3ff1086d01bd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.171227 Aug 24 16:05:27.343068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1212/2452] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:27 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:27.896696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:27.897319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:27.903863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:27.904352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:27.904791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:27.905521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:27.905979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:27.906403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:27.970369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:27.980123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:27.981670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:27.982816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5a22fb95-1f96-4a06-a930-3d93e92911ba tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090781 Aug 24 16:05:27.983369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1241/2453] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:28.364358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:28.366060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:28.371788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:28.372269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:28.372700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:28.373417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:28.373863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:28.374278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:28.512347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:28.520526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9ec8e055-2bbf-4d06-94a1-0807710546f0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.160527 Aug 24 16:05:28.521227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1213/2454] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:28 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:29.006028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:29.006642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:29.013272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:29.013758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:29.014197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:29.014889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:29.015336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:29.015811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:29.035060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:29.093128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:29.102480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:29.103941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:29.105082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a60e899f-3167-412f-b606-1f2014ada45e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.103153 Aug 24 16:05:29.105635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1242/2455] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:29.546341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:29.546956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:29.555723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:29.556553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:29.557227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:29.557947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:29.558410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:29.558845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:29.688500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:29.697371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cf6e054d-1822-41bd-8dd3-38a5f8f56b09 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154839 Aug 24 16:05:29.697985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1214/2456] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:29 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:30.127685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:30.128241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:30.134915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:30.135399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:30.135878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:30.136567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:30.137020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:30.137446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:30.204699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:30.214731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:30.216306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:30.217449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b7a3543b-3165-43a7-99bc-a5ee412ab56c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093822 Aug 24 16:05:30.218001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1243/2457] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:30.718391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:30.719005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:30.726242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:30.726724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:30.727154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:30.727868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:30.728323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:30.728734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:30.860508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:30.868659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9b0cff53-c909-4593-8463-ed6325ebe5a0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154032 Aug 24 16:05:30.869215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1215/2458] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:30 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:31.240312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:31.240899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:31.247303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:31.247816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:31.248251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:31.248929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:31.249380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:31.249798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:31.311079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:31.320388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:31.321886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:31.323025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f50f5a1-5d9d-4231-98a4-229654b9796f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086862 Aug 24 16:05:31.323581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1244/2459] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:31.889606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:31.890239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:31.897160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:31.897645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:31.898085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:31.898792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:31.899235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:31.899683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:32.030800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:32.040004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-af2ee340-f17a-49c2-a78c-f9aa0096b190 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154204 Aug 24 16:05:32.040570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1216/2460] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:31 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:32.346478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:32.347092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:32.354292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:32.354777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:32.355217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:32.355943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:32.356397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:32.356838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:32.418859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:32.428215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:32.429733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:32.430896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2aa33f89-b5da-416e-93bb-fa2bac794b3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088383 Aug 24 16:05:32.431454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1245/2461] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:33.062627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:33.063372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:33.070390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:33.070868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:33.071296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:33.072020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:33.072474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:33.072891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:33.204550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:33.214772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0ecee922-482b-4aac-aa29-b6272e5d0913 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156234 Aug 24 16:05:33.215346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1217/2462] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:33 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:33.455460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:33.456065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:33.463396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:33.463911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:33.464431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:33.465045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:33.465499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:33.465927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:33.531802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:33.540406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:33.541906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:33.543041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c51dee17-181a-4366-a017-eb76d2bfe842 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091585 Aug 24 16:05:33.543591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1246/2463] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:34.236375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:34.236973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:34.244307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:34.244793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:34.245233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:34.245931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:34.246392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:34.246818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:34.376676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:34.389553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e1862a09-0911-4c40-9103-50b2a6d1c706 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157035 Aug 24 16:05:34.390120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1218/2464] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:34 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:34.566204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:34.566832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:34.573316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:34.573796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:34.574233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:34.574918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:34.575373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:34.575823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:34.638138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:34.647361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:34.648880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:34.650013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dea3c0c9-d33f-4d75-a7ea-31d7347d4091 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087836 Aug 24 16:05:34.650568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1247/2465] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:35.411888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:35.412520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:35.419000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:35.419474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:35.420009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:35.420690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:35.421135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:35.421552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:35.559279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:35.567816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-36686e3d-0e3c-4590-aa9a-e4ef64aa9f26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159836 Aug 24 16:05:35.568379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1219/2466] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:35 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:35.673000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:35.673550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:35.680771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:35.681264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:35.681766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:35.682408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:35.682866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:35.683324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:35.745545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:35.754095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:35.756314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:35.757461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd256f8c-ed6d-484f-8326-d5098378c9bc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088495 Aug 24 16:05:35.758038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1248/2467] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:36.590136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:36.590683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:36.597103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:36.597580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:36.598021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:36.598774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:36.599222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:36.599667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:36.728526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:36.736550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-38a9def8-2f1c-4cbb-a4d3-09c13c472d26 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150399 Aug 24 16:05:36.737109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1220/2468] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:36 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:36.779665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:36.780288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:36.787387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:36.787904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:36.788348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:36.789034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:36.789491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:36.789917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:36.860401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:36.869526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:36.871027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:36.872210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f5e9ee3b-2b49-4e2d-ac11-38985b25b6ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.096545 Aug 24 16:05:36.872773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1249/2469] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:37.759912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:37.760658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:37.767254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:37.767785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:37.768273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:37.768979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:37.769446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:37.769873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:37.894697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:37.895926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:37.902622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:37.903118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:37.903556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:37.904292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:37.904979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:37.905165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:37.907003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:37.915860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60b1742e-9769-4320-9802-a29483e1dfea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.161311 Aug 24 16:05:37.916432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1221/2470] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:37 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:37.969018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:37.977934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:37.979443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:37.980606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d029652-35aa-4f96-9a55-c4209239c2f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089961 Aug 24 16:05:37.981184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1250/2471] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:05:38.936983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:38.937596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:38.944821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:38.945307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:38.945780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:38.946474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:38.946934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:38.947361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:39.002319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:39.002903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:39.009615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:39.010097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:39.010532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:39.011214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:39.011677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:39.012097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:39.085175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:39.093873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:39.095380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:39.096565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-04a5a5b2-f7a6-4d40-8734-4839d48f42a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098086 Aug 24 16:05:39.097181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1251/2472] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:05:39.107248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:39.116185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c3315e90-c7f5-4fe7-8f63-def375581614 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.183059 Aug 24 16:05:39.116755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1222/2473] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:38 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:40.120340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:40.120892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:40.127227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:40.127751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:40.128195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:40.128889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:40.130054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:40.130501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:40.137603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:40.138204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:40.144535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:40.145018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:40.146087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:40.146782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:40.147228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:40.147660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:40.166076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:40.204336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:40.214557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:40.216112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:40.217257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1e473fcc-f69d-4a1b-bf77-0c0c600cddfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.100948 Aug 24 16:05:40.217820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1252/2474] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:40.293264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:40.301528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f2b4cb2-ec2f-4fa2-a5a7-569bcfa23074 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.167565 Aug 24 16:05:40.302204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1223/2475] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:40 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:41.241212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:41.241826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:41.243705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=54 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:41.249218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:41.249702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:41.250134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:41.250826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:41.251274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:41.251717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:41.315827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:41.322840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:41.323451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:41.325291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:41.326806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:41.327982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-67529ae0-25b5-4e97-a121-5fec412a0fa3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092027 Aug 24 16:05:41.328771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1253/2476] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:41.330010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:41.330509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:41.330949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:41.331713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:41.332205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:41.333396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:41.465622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:41.474925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-769e5c22-45c6-476e-b8a2-d457dc1b4bfc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155814 Aug 24 16:05:41.475487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1224/2477] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:41 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:42.350487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:42.351127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:42.357518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:42.358061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:42.358495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:42.359181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:42.359657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:42.360082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:42.422531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:42.431304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:42.432821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:42.433941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1dd9c1a0-eded-4b88-9904-24c1faf1a20f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087531 Aug 24 16:05:42.434490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1254/2478] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:42.500599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:42.501710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:42.505104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=52 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:42.510589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:42.511074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:42.511507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:42.512242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:42.512711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:42.513122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:42.646193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:42.654403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9500f335-2d0a-4674-b59e-58684ea83d9a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.160827 Aug 24 16:05:42.654985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1225/2479] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:42 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:43.457866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:43.458480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:43.465951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:43.466441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:43.466875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:43.467619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:43.468098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:43.468528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:43.530162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:43.539540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:43.541072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:43.542212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d8985068-dc18-43ca-9f22-7d02cbce8b73 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088270 Aug 24 16:05:43.542762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1255/2480] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:43.675567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:43.676209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:43.682622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:43.683097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:43.683526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:43.684234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:43.684682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:43.685122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:43.813006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:43.822205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a52104d-6271-4139-b3f4-72704f191f0c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150464 Aug 24 16:05:43.822777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1226/2481] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:43 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:44.563685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:44.564303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:44.571062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:44.571548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:44.572015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:44.572712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:44.573173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:44.573607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:44.641190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:44.650448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:44.652026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:44.653173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e901538e-0979-4866-9354-eeb15daefb48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093469 Aug 24 16:05:44.653734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1256/2482] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:44.844398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:44.844938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:44.852307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:44.852787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:44.853220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:44.853911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:44.854366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:44.854797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:44.984114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:44.992467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7c0fcc93-be7e-46a2-8696-6d4e1c00558a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153009 Aug 24 16:05:44.993042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1227/2483] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:44 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:45.676314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:45.676920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:45.683271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:45.683790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:45.684225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:45.684904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:45.685382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:45.685798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:45.747120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:45.756812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:45.758317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:45.759449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-692e14b6-b673-4dc1-88f3-96614668f367 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087041 Aug 24 16:05:45.760034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1257/2484] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:46.014276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:46.014825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:46.021345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:46.021825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:46.022255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:46.022942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:46.023421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:46.023874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:46.153424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:46.162615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d0eb12c8-0224-440a-bfeb-80c1c63a7015 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152478 Aug 24 16:05:46.163180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1228/2485] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:46 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:46.782682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:46.783223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:46.789838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:46.790329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:46.790773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:46.791470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:46.791959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:46.792387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:46.857659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:46.867985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:46.869504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:46.870669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-947d5c24-1f1e-47ae-8db9-f44cf08fd715 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092005 Aug 24 16:05:46.871223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1258/2486] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:47.183981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:47.184591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:47.191024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:47.191535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:47.192007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:47.192699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:47.193706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:47.194175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:47.327034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:47.336132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-250ef78d-647c-4311-b1a6-a2bbb32eea56 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155972 Aug 24 16:05:47.336694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1229/2487] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:47 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:47.894111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:47.894728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:47.901892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:47.902379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:47.902816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:47.903510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:47.903996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:47.904428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:47.908469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:47.970616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:47.979960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:47.981465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:47.982607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e2c709be-8008-4213-bd26-014174f4cd7a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092409 Aug 24 16:05:47.983167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1259/2488] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:48.357705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:48.358325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:48.365029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:48.365544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:48.366189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:48.366971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:48.367495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:48.367992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:48.497556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:48.505731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-44c33c38-6978-4898-a8ba-e47251483da8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151995 Aug 24 16:05:48.506328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1230/2489] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:48 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:49.005396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:49.006054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:49.012525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:49.013005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:49.013441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:49.014121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:49.014577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:49.014998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:49.076342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:49.085752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:49.087272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:49.088459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd7b4555-850f-4b40-89ec-2110b446f732 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086970 Aug 24 16:05:49.089026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1260/2490] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:49.512479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:05:49.512652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:05:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:05:49.527902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:49.528622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:49.535029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:49.535501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:49.535969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:49.536653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:49.537096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:49.538343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:49.669307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:49.677464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7b7ee4aa-8818-40a7-83d8-fd0612bc812f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153831 Aug 24 16:05:49.678039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1231/2491] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:49 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:50.018801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:50.019334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:50.026337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.026828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.027263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.028006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.028434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.028856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.063150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:05:50.112053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:50.112781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:50.119715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.120213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.120838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.121909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.122580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.123044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.166364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3ef89340-b195-4858-940b-37cc7ecbd0ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 204 len: 0 microversion: 2.1 time: 0.150416 Aug 24 16:05:50.167582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1261/2492] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:05:50 2022] DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:05:50.179705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:50.180795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:50.187143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.187912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.188562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.189737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.190360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.190948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.194606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:50.206347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:50.207959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:50.210068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-900a6194-9fb8-49c2-9863-d041b1fa04c9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101676 Aug 24 16:05:50.211329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1232/2493] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:50.298037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:50.298536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:50.305839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.306559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.306862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.307536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.308028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.308459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.333287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:50.335196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Going to try to terminate instance {{(pid=132518) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:05:50.342002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-372f841c-129d-4144-9810-e2565c033675 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.166802 Aug 24 16:05:50.342573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1262/2494] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:50.416017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da693a4c-e12c-420b-9363-784171f04cc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 204 len: 0 microversion: 2.1 time: 0.121565 Aug 24 16:05:50.416895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1233/2495] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:05:50 2022] DELETE /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:05:50.427508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:50.428581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:50.435105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.435603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.436091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.436809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.437253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.437677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.569882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:50.577992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fde9c4f6-f07f-47b2-8e75-ac5c01d09030 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157012 Aug 24 16:05:50.578559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1263/2496] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:50.701531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:50.702245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:50.708651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.709805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.710464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.711043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:50.711706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:50.711978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:50.843295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:50.852497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1194e9f7-b1fe-4e1e-903d-829312de02d6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.156835 Aug 24 16:05:50.853068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1234/2497] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:50 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:51.235575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:51.236217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:51.242705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.243196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.243647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.244339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.244792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.245222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.307396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:51.316228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:51.317752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:51.319467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-47d2fd9b-3277-4b8b-94e4-4f292d0e7ef8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087834 Aug 24 16:05:51.320057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1264/2498] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:51.364107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:51.364723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:51.370675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.371154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.371592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.372299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.372796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.373291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.511429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:51.519897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71feb03e-dc20-4048-9f38-0690fadf3309 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159610 Aug 24 16:05:51.520454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1235/2499] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:51.598580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:51.599195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:51.605437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.605922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.606357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.607142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.607597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.608047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.735962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:51.745273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-efcd2596-ebad-4873-936b-418387bd6216 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.150462 Aug 24 16:05:51.745851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1265/2500] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:51.873622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:51.874236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:51.881478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.881992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.882446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:51.883136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:51.883586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:51.884041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:52.018995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:52.027809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-922884a0-7fe6-4fed-adb8-6b91ef755667 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158143 Aug 24 16:05:52.028375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1236/2501] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:51 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:52.342410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:52.343018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:52.349540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:52.350679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:52.351197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:52.351974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:52.352472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:52.352935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:52.414128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:52.423132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:52.424672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:52.425805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b5855641-02d6-450f-a1a9-2609c076f34d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087413 Aug 24 16:05:52.426363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1266/2502] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:52.543066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:52.543697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:52.549674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:52.550162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:52.550599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:52.551295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:52.551779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:52.552205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:52.682741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:52.690883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a67db61f-f001-4106-a616-4adba7879174 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.151688 Aug 24 16:05:52.691505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1237/2503] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:52.767489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:52.768144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:52.774826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:52.775308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:52.775763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:52.776451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:52.776903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:52.777331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.050391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:53.051023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:53.058176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:53.058660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:53.059095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.059822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:53.060274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:53.060698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.079736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:53.186401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:53.195664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2d8258ae-45fe-458a-99f0-24a4e9a80e01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.431873 Aug 24 16:05:53.196252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1267/2504] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:53.232942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:53.242200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb2528f6-1f49-4f31-b7f5-f089ccb66187 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.195795 Aug 24 16:05:53.242769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1238/2505] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:53 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:53.449644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:53.450570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:53.460110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:53.460827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:53.461473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.462499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:53.463184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:53.463847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.532256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:53.542054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:53.543597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:53.544772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-330c37f2-51c1-4909-9cc0-69a988ec8d21 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.100052 Aug 24 16:05:53.545326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1268/2506] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:53.712989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:53.713518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:53.719417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:53.719996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:53.720366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.721050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:53.721500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:53.721942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:53.856052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:53.864190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9de6912a-5408-414f-8322-32d0816bf612 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155499 Aug 24 16:05:53.864741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1239/2507] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:54.218121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:54.218742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:54.224952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.225462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.225899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.226590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.227042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.227466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.262711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:54.263355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:54.270010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.270495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.270935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.272652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.272907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.273340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.404653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:54.413485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3332a06e-41ec-4cee-b7f2-a8875f8801c9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.199284 Aug 24 16:05:54.414071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1269/2508] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:54.435466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:54.444315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-090e2d69-be43-4b28-9014-7c0f0e868091 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.185367 Aug 24 16:05:54.444856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1240/2509] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:54 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:54.569653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:54.570303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:54.576569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.577050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.577478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.578160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.578605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.579024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.642538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:54.651281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:54.652874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:54.654015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-218568ab-e3d6-49ee-a505-b9386b83e449 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089281 Aug 24 16:05:54.654568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1270/2510] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:54.885944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:54.886550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:54.892465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.892947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.893369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:54.894095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:54.894521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:54.894938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.025869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:55.034197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-054d6dc2-be03-4592-96b3-55c92ed3663e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152160 Aug 24 16:05:55.034757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1241/2511] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:55.434475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:55.435123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:55.441046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:55.441535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:55.441972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.442662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:55.444036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:55.444508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.466296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:55.466909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:55.473467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:55.473952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:55.475113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.475923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:55.476380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:55.476808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.640303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:55.649471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-44eff657-bcb5-4383-892d-8913f3dc5af1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218770 Aug 24 16:05:55.650141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1271/2512] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:55.662588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:55.670856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d06d7871-2676-468b-9f95-0c368d2bed19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.208394 Aug 24 16:05:55.671804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1242/2513] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:55 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:55.676693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:55.677315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:55.683114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:55.683591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:55.684055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.684738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:55.685190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:55.685610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:55.748495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:55.758039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:55.759453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:55.760621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7794774-a3af-4ec5-934e-58738c95a643 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087818 Aug 24 16:05:55.761168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1272/2514] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:56.055990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:56.056520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:56.062638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.063118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.063586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.064295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.064749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.065179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.196695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:56.204865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-92ea48bb-0077-4133-8c7a-d90b53fdee8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.153462 Aug 24 16:05:56.205430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1243/2515] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:56.670480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:56.671099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:56.678251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.678932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.679373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.680099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.680561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.681019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.691896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:56.692500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:56.698972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.699459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.699914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.700665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.701112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.701534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.883424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:56.891859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-61ab4a46-7878-42f2-b049-b1231c4a8a06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225137 Aug 24 16:05:56.892467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1273/2516] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:56.894892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:56.897857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:56.898488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:56.904474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2e3cbf7c-e2bb-42fe-9568-427dd0784dca tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.216288 Aug 24 16:05:56.905236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.905389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1244/2517] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:56 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:56.905586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.906155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.906867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:56.907337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:56.907798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:56.912851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:05:56.975168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:56.983913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:56.985399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:56.986521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5391cccb-8c88-4708-a965-3dcbdfa65e33 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093145 Aug 24 16:05:56.987066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1274/2518] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:57.226482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:57.227886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:57.233962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:57.234447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:57.234899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:57.235583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:57.236065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:57.236491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:57.366654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:57.374699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f4550114-4380-4f3f-98d2-7405d84469a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152177 Aug 24 16:05:57.375255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1245/2519] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:57.913769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:57.914368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:57.921657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:57.922157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:57.922625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:57.923526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:57.923840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:57.924267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:57.926230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:57.926852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:57.934073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:57.934588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:57.935116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:57.935859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:57.936323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:57.936785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:58.126933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:58.131879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:58.136573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b5550c87-84d5-4385-80b9-016bcf40f72f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226827 Aug 24 16:05:58.137173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1275/2520] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:58.140220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a7a41f9b-2f31-4ede-927e-33aeb71da36f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.217753 Aug 24 16:05:58.140979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1246/2521] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:58.141904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:58.142577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:58.150301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:58.150794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:58.151230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:58.151991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:58.152418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:58.152847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:58.227345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:58.236476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:58.237992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:58.239115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3506f864-04b0-447d-a49e-2ffc351ce3c0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101029 Aug 24 16:05:58.239762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1276/2522] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:58.395025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:58.395657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:58.402357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:58.402835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:58.403266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:58.403975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:58.404426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:58.404845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:58.543676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:58.551980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c137babd-d34c-4c13-9823-50e447b07db5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.160731 Aug 24 16:05:58.552555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1247/2523] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:59.158943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:59.159539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:59.162068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:59.162697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:59.166227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.166695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.167103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.167846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.168306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.168743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.169104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.169585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.170012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.170703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.171279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.171728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.368276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:59.371325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:59.376564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-de308c59-8cc3-4986-a95b-f8859d8a9eed tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.218279 Aug 24 16:05:59.377222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1248/2524] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:59 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:05:59.379767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b3db742-6424-4f85-9ab0-30a6ab46e493 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.224677 Aug 24 16:05:59.381016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1277/2525] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:05:59.382807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:59.383564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:59.389539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.390197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.390699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.391386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.391868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.392295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.453815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:59.463777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:59.465278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:59.466411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e6bcc3b-ad69-427d-a0da-67cdc4e22cfe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088217 Aug 24 16:05:59.466967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1249/2526] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:05:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:05:59.574566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:05:59.575173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:05:59.581202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.581688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.582116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.582799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:05:59.583244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:05:59.584130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:05:59.721405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:05:59.730587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e48bd922-d56e-4c5c-98fa-d90dbb3db132 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159897 Aug 24 16:05:59.731145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1278/2527] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:05:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:00.398345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:00.398994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:00.402235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:00.402856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:00.405662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.406150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.406590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.407291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.407771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.408201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.409593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.410087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.410585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.411280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.411887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.413220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.626496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:00.629810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:00.634977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9bd270c9-1126-422d-8329-a6492171c942 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.236608 Aug 24 16:06:00.635562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1279/2528] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:00.638534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c74d179-766d-45d8-b8ec-d750aca97145 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.244288 Aug 24 16:06:00.640296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:00.641029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:00.641396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1250/2529] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:00 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:00.646987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.647474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.647944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.648658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.649112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.649599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.716508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:00.725742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:00.727233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:00.728409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-13a81646-34bb-4002-bf81-750ec8dcaa77 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091914 Aug 24 16:06:00.728960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1280/2530] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:00.752120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:00.752733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:00.759432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.759949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.760390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.761498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:00.761656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:00.761969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:00.898619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:00.907726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8dbe9710-6500-4659-842f-ce5a9717a365 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159344 Aug 24 16:06:00.908314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1251/2531] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:01.656078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:01.656744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:01.659321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:01.659967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:01.663433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.663962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.664403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.665102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.665571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.666003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.666438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.666915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.667371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.668091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.668545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.668959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.867165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:01.871177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:01.878893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a890ea12-e0c8-46af-839b-20544b3e489e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226673 Aug 24 16:06:01.879404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-576b6f1b-d8e5-43a6-a634-6f8d7b4cae6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.223847 Aug 24 16:06:01.879567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1281/2532] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:01.880165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1252/2533] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:01 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:01.885042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:01.885805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:01.891533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.892056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.892492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.893365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.893832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.894258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.930595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:01.931351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:01.937592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.938155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.938600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.939307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:01.939782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:01.940210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:01.962462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:01.971368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:01.972923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:01.974320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1b1d139a-da22-43e1-98a7-1dd510113cdc tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093659 Aug 24 16:06:01.975494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1282/2534] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:02.074910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:02.083128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-af2bd1af-c350-4622-adc8-3cdd550e7c03 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157186 Aug 24 16:06:02.084015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1253/2535] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:02.901760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:02.902333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:02.902723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:02.902836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:02.908700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:02.908920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:02.909189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:02.909315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:02.909630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:02.909825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:02.910327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:02.910446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:02.910840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:02.910975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:02.911273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:02.911455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:03.109783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:03.112803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:03.118475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de467e14-fae8-405a-8993-9e2abc60e5e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221511 Aug 24 16:06:03.119072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1283/2536] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:03.123949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:03.124556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:03.125951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-86bb8356-14d0-479d-b024-263433330c6e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.228275 Aug 24 16:06:03.135708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1254/2537] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:03.136041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:03.136041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:03.136041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:03.136364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:03.136456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:03.136556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:03.136670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:03.136670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:03.142104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:03.142578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:03.143137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:03.143876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:03.144331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:03.144754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:03.149610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:03.207015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:03.216761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:03.218376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:03.219584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-83962ed1-7e69-4f50-88eb-abfa899a8c2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.099600 Aug 24 16:06:03.220467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1284/2538] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:03.291431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:03.299768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a2d9326b-7249-4548-bb95-fd9ff188bbbb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.171994 Aug 24 16:06:03.300334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1255/2539] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:04.140871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:04.141513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:04.148470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:04.148957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.149082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.149215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:04.149470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.150168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.150626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.151065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.155481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.155995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.156439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.157704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.157704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.157982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.354614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:04.358445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:04.363070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-12e21ee6-5d4a-460b-b852-4db3df1a959e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225996 Aug 24 16:06:04.363653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1285/2540] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:04.366870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-51b6a678-78f8-4bca-a771-7ae2c7e1d4b6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222793 Aug 24 16:06:04.367498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1256/2541] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:04.379140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:04.379140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:04.379140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.379140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.379590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.379590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.379590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.379590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.385878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:04.386488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:04.392409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.392834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.393269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.393959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:04.394415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:04.394835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:04.448757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:04.457542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:04.460102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:04.461262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e6276591-7e1b-4097-85b4-4c1a6e992606 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.096696 Aug 24 16:06:04.461819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1286/2542] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:04.539551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:04.549133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d6d4fea4-c63a-47d2-aad7-471ed13bb8fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.166931 Aug 24 16:06:04.549708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1257/2543] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:05.385329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:05.385942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:05.390299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:05.390916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:05.392425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.392911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.393343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.394032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.394487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.394904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.398000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.398483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.398922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.399618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.400100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.400530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.600380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:05.603498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:05.608742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9f78eb3e-28dc-478d-902f-ab5e0494f984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.227834 Aug 24 16:06:05.609400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1287/2544] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:05.611922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e1f8e8e1-c629-475a-8ae1-c3b88de8998d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.225447 Aug 24 16:06:05.623213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1258/2545] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:05 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:05.623429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:05.623429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:05.623672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:05.623672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:05.623872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.623872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.623872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.623872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.624211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.624211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.624733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.625211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.625644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.626336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:05.626790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:05.627214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:05.697398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:05.706011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:05.707505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:05.708959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3bde235b-68cc-4713-b1d3-e66f0b1dadc8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098319 Aug 24 16:06:05.709933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1288/2546] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:05.782250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:05.790516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c4e42d62-8352-498f-9ad7-de83c3dde8d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.176673 Aug 24 16:06:05.791105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1259/2547] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:06.631882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:06.632637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:06.634680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:06.635468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:06.639145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.639657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.640350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.641587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.642046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.642473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.642595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.643022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.643475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.644198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.644652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.645096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.867136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:06.873111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:06.876111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91bf9a28-3ba1-4743-ba34-5adf5c8ff671 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.246857 Aug 24 16:06:06.876925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1260/2548] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:06 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:06.885248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f7e6800-89ce-4ae6-bf6a-90c67f52331b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.258416 Aug 24 16:06:06.885773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1289/2549] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:06.890402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:06.891235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:06.891413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:06.891879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:06.898861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.899545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.900224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.900726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.900958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.901221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.901423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.901665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.901852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.902402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:06.902856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:06.903283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:06.986001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:06.996534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:06.998041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:06.999201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c17aef54-674c-49c3-937c-79f6e5960599 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.113331 Aug 24 16:06:07.000014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1261/2550] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:07.075472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:07.078748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:07.084624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e764720-f85a-4e0d-a7f9-6cb98c90b36d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.197814 Aug 24 16:06:07.085465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1290/2551] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:07.903085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:07.903713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:07.907378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:07.908024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:07.910221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:07.910698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:07.912251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:07.912491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:07.912942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:07.913485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:07.916115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:07.916817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:07.917059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:07.917771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:07.918300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:07.918739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:08.111178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:08.115234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:08.119434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a48d2644-eac6-4615-a1f1-c5db24f10f79 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220210 Aug 24 16:06:08.120031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1262/2552] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:07 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:08.123668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-33cf784f-b676-427f-8482-ed097bb97eeb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220118 Aug 24 16:06:08.125788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1291/2553] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:08.125942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:08.125942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:08.129684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:08.131884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:08.132215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:08.132699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:08.133129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:08.133820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:08.134267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:08.134686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:08.138584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:08.139052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:08.139489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:08.140235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:08.140696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:08.141128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:08.207509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:08.217392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:08.218918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:08.220096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f4651f9e-9878-40e5-91ac-947aa29eac2a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.099152 Aug 24 16:06:08.220844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1263/2554] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:08.290471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:08.298932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-69e9758e-3f77-437f-b95f-ec002881e380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.173730 Aug 24 16:06:08.299512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1292/2555] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:09.141057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:09.141660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:09.147433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:09.148646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:09.148958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.149450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.149887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.150593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.151051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.151476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.155096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.155594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.156057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.156764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.157220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.157681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.344703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:09.352143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:09.353611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b4d4aab2-be27-4c14-b2b9-958006872e88 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.216317 Aug 24 16:06:09.355934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1264/2556] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:09 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:09.358701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:09.359307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:09.361115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c06356d3-d6a6-4345-bf1b-23e83a775237 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218194 Aug 24 16:06:09.361917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1293/2557] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:09.366657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.367150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.367599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.368330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.368788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.369219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.376678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:09.377358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:09.384704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.385304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.385815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.386585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:09.387110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:09.387610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:09.440179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:09.449695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:09.451192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:09.452369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-57cfd5dc-4d4e-4487-a0bd-a676e7c99a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097256 Aug 24 16:06:09.452919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1265/2558] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:09.531269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:09.540023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fcf40ca9-7e93-4199-be63-f50020dcc9bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.167067 Aug 24 16:06:09.540597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1294/2559] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:10.376567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:10.377222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:10.385419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.385912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.386350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.386790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:10.387264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.387437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:10.387558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.393583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.394073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.394520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.395213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.395772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.396195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.586849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:10.590195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:10.595215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e5c8a86e-72e9-4e18-a676-5189e0e58b93 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222486 Aug 24 16:06:10.595874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1266/2560] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:10 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:10.598511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d676b7f4-1e4a-4b23-9b53-a1d5c9622b84 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217134 Aug 24 16:06:10.611693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1295/2561] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:10.611907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:10.611907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:10.612124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:10.612124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:10.612329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.612329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.612329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.612329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.612700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.612700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.612868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.612868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.612868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.612868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:10.613248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:10.613353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:10.682848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:10.691602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:10.693121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:10.695509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f01132ba-2aa9-4a45-b373-f4082ba84b26 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098752 Aug 24 16:06:10.696118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1267/2562] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:10.766438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:10.774654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1214d6aa-d8ae-44fd-a7d7-1d516228ff87 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.174657 Aug 24 16:06:10.775219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1296/2563] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:11.616523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:11.617390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:11.621406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:11.622249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:11.623806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.624297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.624736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.625272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:11.625443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.625883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.626338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.630408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.630957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.631423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.632168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.632625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.633052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.831408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:11.836337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:11.840847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-77e4e696-43b6-46c2-b16b-9b6f3db2914e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.228290 Aug 24 16:06:11.841622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1268/2564] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:11 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:11.846083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:11.846523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:11.852741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.852938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d56b07c-1436-4056-8d12-59188eb614ba tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.236338 Aug 24 16:06:11.853228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.853665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.853805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1297/2565] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:11.854366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.854819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.855246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.859715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:11.860561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:11.866838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.867370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.867865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.868574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:11.869034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:11.869465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:11.919258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:11.928546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:11.930043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:11.931277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a23c073e-e515-449f-8668-ab786ccc441c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088941 Aug 24 16:06:11.931885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1269/2566] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:12.017029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:12.025939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ca75da0b-ec97-45b3-bea3-be896104d3bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.171102 Aug 24 16:06:12.026501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1298/2567] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:12.864982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:12.865624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:12.868386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:12.874277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:12.874635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:12.875112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:12.875280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:12.875429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:12.876038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:12.876493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:12.876919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:12.881381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:12.881866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:12.882588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:12.883288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:12.883773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:12.884204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:13.075729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:13.079712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:13.084269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b422b564-e8fc-43d7-bfae-013f76397373 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.223135 Aug 24 16:06:13.084846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1270/2568] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:12 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:13.089623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-32ddc59c-84d8-4530-bd16-840e30206a93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219053 Aug 24 16:06:13.089968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:13.090516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1299/2569] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:13.095310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:13.095952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:13.101932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:13.102888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:13.103389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:13.103867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:13.104568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:13.105058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:13.105488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:13.108350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:13.108839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:13.110465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:13.110465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:13.110465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:13.110891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:13.197834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:13.201908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:13.209013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:13.211087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:13.212374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f1b52b73-531c-49ec-a6c8-6da54f401075 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.126078 Aug 24 16:06:13.212945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1271/2570] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:13.261497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:13.269544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5ca245ba-15bf-48ec-878a-bf68e94e26d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.177953 Aug 24 16:06:13.270097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1300/2571] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:14.107545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:14.108149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:14.110744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:14.111365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:14.114767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.115255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.115718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.116417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.117227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.117663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.117920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.118410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.118853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.119602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.120576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.121078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.318361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:14.321533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:14.327204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-982e0465-db8f-4fda-84f6-5d5fa032daf6 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.223683 Aug 24 16:06:14.327804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1272/2572] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:14 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:14.329747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-13827f69-3e69-481b-a2ee-28c65e92ed7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222720 Aug 24 16:06:14.330459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1301/2573] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:14.332440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:14.333044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:14.334981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:14.335621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:14.339526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.340110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.340557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.341262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.341659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.341773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.342132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.342266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.342721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.343477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:14.344027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:14.344545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:14.431619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:14.440413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:14.441915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:14.443061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d9a61cd8-fc97-4c34-a3a7-d8a599b29418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.114342 Aug 24 16:06:14.443624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1273/2574] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:14.501898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:14.510173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1246b7f8-49cf-4e56-adcf-593aeb5e3ce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.178945 Aug 24 16:06:14.510735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1302/2575] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:15.362854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:15.363444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:15.363802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:15.364449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:15.370793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.371272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.371581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.371804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.372229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.372448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.372930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.373247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.373437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.373803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.373992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.374449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.574474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:15.577724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:15.582662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-659d98f5-ae1a-4621-8167-a7342af8672d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222606 Aug 24 16:06:15.584332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1303/2576] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:15.587004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-11dd63bd-5f63-4ec4-a1a1-f7c725cfc99b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.227946 Aug 24 16:06:15.587930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1274/2577] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:15 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:15.589328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:15.589934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:15.600717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:15.600717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:15.601169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.601169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.601169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.601169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.602187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.602187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.610928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.610928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.610928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.610928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:15.611447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:15.611447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:15.688155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:15.698031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:15.699545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:15.700768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9a6375fe-103c-455a-ac0c-db12a33cac80 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.115737 Aug 24 16:06:15.701329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1304/2578] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:15.757172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:15.766130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9cca8752-893e-420b-bdc7-d6b588a64437 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.177256 Aug 24 16:06:15.766694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1275/2579] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:16.608432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:16.609047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:16.610276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:16.610898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:16.615521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.616040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.616478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.617816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.617955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.618301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.618432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.618749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.618884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.619525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.620005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.620432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.810028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:16.817096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:16.818237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9271c0df-55ae-4143-a783-7718bf8cec0a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.211999 Aug 24 16:06:16.818817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1276/2580] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:16.824956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:16.825698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:16.826444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b6217838-1b0d-49ba-9bd7-ff15f1f38cc2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221812 Aug 24 16:06:16.827021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1305/2581] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:16 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:16.831691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:16.832463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.832722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:16.833147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.833935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.834840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.835400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.837052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.841665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.842395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.843017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.843765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:16.844229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:16.844657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:16.912793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:16.922859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:16.924393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:16.925537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ef4d585a-a609-444a-bdb4-b439f9866058 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.104573 Aug 24 16:06:16.926094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1277/2582] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:17.005024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:17.014229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1aaf449d-1cf2-4a50-af9b-4ff4119ab14f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.185937 Aug 24 16:06:17.014799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1306/2583] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:17.838964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:17.839517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:17.846620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:17.847115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:17.847556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:17.848288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:17.848933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:17.849151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:17.850537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:17.851877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:17.858418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:17.858904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:17.859332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:17.860065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:17.860515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:17.860934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:17.879658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:18.049723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:18.052993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:18.059267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da0a73d0-4f45-4c0f-b692-58bdbcabe5aa tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.224481 Aug 24 16:06:18.060257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1278/2584] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:18.064379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:18.065049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:18.066455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4505fdce-8fed-48c8-ab51-d81773ef8e1a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.219959 Aug 24 16:06:18.067284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1307/2585] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:18.072265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:18.072816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:18.073252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:18.073745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:18.074161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:18.075189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:18.076100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:18.076707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:18.080907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:18.081388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:18.081813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:18.082503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:18.082948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:18.083653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:18.149887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:18.158618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:18.160135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:18.161276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2d6eb080-bcf7-43ce-9f65-eb900560134f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.100343 Aug 24 16:06:18.161831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1279/2586] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:18.239351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:18.247605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-19e42c7a-aafc-44f0-98a0-6d379e33477a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.178789 Aug 24 16:06:18.248193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1308/2587] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:19.084192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:19.085091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:19.090003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:19.090624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:19.091656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.092220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.092607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.093311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.093774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.094203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.097065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.097609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.098005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.098708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.099176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.099615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.290704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:19.297683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:19.298923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3156539c-88f8-4680-819f-1cd837013eea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218824 Aug 24 16:06:19.299587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1280/2588] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:19.303964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:19.305231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:19.307893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4f2f9c48-007e-47f7-a54b-4558b7e95573 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222242 Aug 24 16:06:19.308679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1309/2589] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:19 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:19.311946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.312427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.312856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.313553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.314001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.314416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.322087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:19.322689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:19.328530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.329010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.329465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.330153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:19.330596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:19.331013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:19.384257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:19.393402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:19.394993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:19.396265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f5cc91c2-adf0-451b-a4c3-f794cb5a1a0f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095833 Aug 24 16:06:19.396903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1281/2590] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:19.478565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:19.486643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-03bfc581-4f3d-43e6-be4a-0fb7252ee529 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.177072 Aug 24 16:06:19.487217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1310/2591] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:20.321346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:20.321969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:20.328503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.328992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.329428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.329797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:20.330268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.330398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:20.330566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.330972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.338259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.338745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.339180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.340029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.340487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.340915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.536035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:20.540350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:20.545574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b68a82fd-f7de-454d-b481-640073ef82eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.219622 Aug 24 16:06:20.546195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1311/2592] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:20 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:20.548630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-56890b69-be79-4d57-8839-6e080a093411 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.231639 Aug 24 16:06:20.549314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1282/2593] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:20.551013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:20.551624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:20.558475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.558997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.559432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.560167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.560623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.561046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.565761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:20.566464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:20.573964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.574414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.574927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.575734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:20.576287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:20.576726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:20.624957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:20.634597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:20.636133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:20.637298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9a662549-ba1c-458e-8777-772052d9ea10 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090208 Aug 24 16:06:20.637866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1312/2594] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:20.725112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:20.733491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4354ba3e-d9a7-49c5-a08c-97bb7a288708 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.171438 Aug 24 16:06:20.734065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1283/2595] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:21.568369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:21.568977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:21.570604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:21.571612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:21.575585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.576099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.576532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.577223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.577674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.578090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.578198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.578646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.579087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.579830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.580298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.580729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.775524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:21.778187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:21.784035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e53b0414-580b-4a07-8426-0785b44d0a24 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.219418 Aug 24 16:06:21.784623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1313/2596] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:21 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:21.786600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0fa80dd6-ab89-44ea-a8da-960c257f9595 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220522 Aug 24 16:06:21.787813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1284/2597] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:21.790145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:21.790746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:21.794807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:21.795990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:21.796859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.797354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.797796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.798494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.798958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.799391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.803270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.803779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.804217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:21.804908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:21.805388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:21.805804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:22.109335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:22.118721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:22.120338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:22.121474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6ea3fbde-64e6-48df-969d-5227e0f821ff tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.335935 Aug 24 16:06:22.122030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1314/2598] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:22.181230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:22.189300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f8129609-8683-448e-8193-904ab9788960 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.400008 Aug 24 16:06:22.189860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1285/2599] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:22.806333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:22.806879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:22.806989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:22.807536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:22.813731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:22.813966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:22.814218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:22.814450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:22.814662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:22.814885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:22.815359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:22.815580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:22.815850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:22.816079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:22.816274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:22.816493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:23.010123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:23.017115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:23.018212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ccfb5fb9-0c86-49b0-aa91-decd3e7b3b2b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.216201 Aug 24 16:06:23.018774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1315/2600] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:23.025438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1da4e2de-2c75-4bab-bb48-7ed32b05c014 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222357 Aug 24 16:06:23.025990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1286/2601] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:23.144769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:23.145389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:23.151529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:23.152053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:23.152490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:23.153184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:23.153641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:23.154077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:23.211368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:23.212021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:23.218072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:23.218565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:23.219007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:23.219747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:23.220208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:23.220639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:23.221805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:23.231115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:23.232740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:23.233957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b3559a3d-e596-41f4-bf42-16c23b258cd7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093180 Aug 24 16:06:23.234511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1316/2602] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:23.350632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:23.360180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c0685a79-b3e9-457b-8a96-6adf77104123 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.153621 Aug 24 16:06:23.360746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1287/2603] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:24.039859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:24.040479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:24.046647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:24.047281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.047446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:24.047817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.048265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.048966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.049427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.049848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.053994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.054741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.054920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.055646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.056124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.056550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.075488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:24.247379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:24.254493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:24.258158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c920515b-ee85-4098-acc2-ce84d85b794e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222089 Aug 24 16:06:24.258954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1317/2604] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:24.264198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4a374170-8d51-4b32-b335-758e0a92e310 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221350 Aug 24 16:06:24.264762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1288/2605] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:24.273012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:24.273654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:24.279512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.280050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.280481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.281160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.281639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.282061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.343577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:24.353084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:24.354490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:24.355664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3c7a3d67-51d6-4e08-9661-7678c66a65f1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087001 Aug 24 16:06:24.356237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1318/2606] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:24.383411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:24.384059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:24.390062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.390544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.390994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.391702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:24.392162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:24.392586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:24.519997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:24.528236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-409c0203-d872-4bf6-92f5-1ab7ec05a1c0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.149890 Aug 24 16:06:24.528791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1289/2607] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:25.285352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:25.286147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:25.286523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:25.287187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:25.293676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.293955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.294162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.294445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.294595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.294882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.295297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.295577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.295777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.296061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.296214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.296539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.490841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:25.499856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-249a522d-e345-473b-b36f-1d157854edea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.223789 Aug 24 16:06:25.500444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1319/2608] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:25 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:25.502343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:25.504906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:25.505724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:25.512152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3520254d-9f68-463d-ad29-3476dfc065b0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230339 Aug 24 16:06:25.512408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.516208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.516409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1290/2609] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:25.516526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.516526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.516526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.516526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.549320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:25.549855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:25.556359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.556844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.557280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.557978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:25.558430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:25.558856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:25.586673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:25.595703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:25.597243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:25.598386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-354d0a89-58e9-4a61-a59e-3dc18009550c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097024 Aug 24 16:06:25.598944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1320/2610] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:25.691582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:25.700779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7384d56b-4ea1-4c64-a5f7-818ce0e06abd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155416 Aug 24 16:06:25.701352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1291/2611] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:26.521911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:26.522595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:26.529461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.529949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.530380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.531083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.531546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.532006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.537522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:26.538666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:26.547178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.547680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.548112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.548833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.549269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.549689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.764496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:26.772612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:26.773728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7c5e815-b64f-405e-9628-0d09a9885879 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.255601 Aug 24 16:06:26.774324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1321/2612] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:26 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:26.778843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:26.779451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:26.782020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ce1c2ef-5960-4f67-b7a9-bd6be4f6e0a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.250666 Aug 24 16:06:26.782878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1292/2613] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:26.796873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:26.796873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:26.797256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.797256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.797256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.797256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.798021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.798021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.798212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.798212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.798212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.798212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:26.798542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:26.798542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:26.902349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:26.915078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:26.916760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:26.917940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c32e84ee-0ef6-4213-8d84-436994043ff8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.142690 Aug 24 16:06:26.918562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1322/2614] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:26.974641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:26.985452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-09d62d3c-026a-495b-9d8b-6b6787bb7c1b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.201598 Aug 24 16:06:26.986022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1293/2615] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:27.800695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:27.801237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:27.808304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:27.808614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:27.809054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:27.809204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:27.809330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:27.809892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:27.810340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:27.810757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:27.815940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:27.816434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:27.817009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:27.817724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:27.818214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:27.818645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:28.016564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:28.019914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:28.030434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-22306f93-007a-4d54-a779-0d12bf813138 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225548 Aug 24 16:06:28.031026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1294/2616] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:28.033767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eeb68f9f-c495-48b4-8146-a0e9dbc66a49 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.236602 Aug 24 16:06:28.034905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1323/2617] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:27 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:28.036253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:28.036934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:28.042353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:28.043358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:28.044047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:28.044550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:28.045126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:28.045833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:28.046361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:28.046944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:28.050799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:28.051224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:28.051677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:28.052405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:28.052852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:28.053271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:28.057416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:28.136664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:28.145222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:28.147390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:28.149931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e1f6bf2d-40f3-4af0-aef6-56e61afddf81 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.117953 Aug 24 16:06:28.150500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1295/2618] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:28.209310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:28.218234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6625d31f-92d1-42d3-aa47-14e16ed554aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.181986 Aug 24 16:06:28.218797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1324/2619] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:29.055676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:29.056680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:29.063216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:29.063216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:29.064125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.064678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.065117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.065814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.066266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.066696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.067490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.068026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.068477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.069188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.069703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.070245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.271848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:29.276461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:29.281314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5755bc96-50f0-4321-b1a3-4942e3e0caa3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.232070 Aug 24 16:06:29.282241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1296/2620] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:29.284608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c711fb7a-45cb-418f-b9aa-3fc01bbe88d5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.232184 Aug 24 16:06:29.286572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1325/2621] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:29 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:29.286720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:29.287300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:29.293074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:29.293983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:29.294428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.294928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.295372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.296183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.296648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.297209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.301592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.302080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.302519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.303217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:29.303695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:29.304748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:29.374708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:29.384698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:29.386182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:29.387325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e4d0efff-23d6-4b6c-be7e-47b1612ff8b0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.104527 Aug 24 16:06:29.387906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1297/2622] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:29.463698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:29.471935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4c51faee-4de9-4c74-a37e-4a98f6a6517f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.183427 Aug 24 16:06:29.472497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1326/2623] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:30.303871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:30.305245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:30.305832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:30.306443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:30.311756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.312242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.312677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.312797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.313248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.313365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.313679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.313792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.314213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.314368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.314821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.315243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.517639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:30.524624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:30.526867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-119e8458-de38-4781-83ed-a465ae4dd24c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226868 Aug 24 16:06:30.527539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1298/2624] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:30.531978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:30.532585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:30.533297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-369d2011-7ad0-41fc-bea4-32f984007b27 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.231775 Aug 24 16:06:30.534072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1327/2625] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:30 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:30.538858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.539423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:30.539968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.540118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:30.540421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.541119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.541579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.542005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.546142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.546695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.547196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.547994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:30.548555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:30.549043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:30.613814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:30.622968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:30.624507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:30.625655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fca5c84a-c1e4-44ad-a7a1-db17055cd726 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097178 Aug 24 16:06:30.626409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1299/2626] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:30.696621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:30.704879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9195819a-8e83-4175-b5bd-86da8cbb72ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.169950 Aug 24 16:06:30.705447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1328/2627] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:31.558766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:31.559382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:31.562079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:31.562833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:31.566078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.566561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.566997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.567832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.568175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.568595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.569290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.570637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.571191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.571938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.572401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.572861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.777771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:31.780644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:31.786329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5fdd6cb3-2af8-4b0e-be0b-9b615a27fd9a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.231939 Aug 24 16:06:31.799842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1300/2628] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:31.800068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2a26a4cb-8623-413a-85f4-3a66f6e79090 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.231541 Aug 24 16:06:31.800068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1329/2629] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:31 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:31.800256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:31.800256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:31.800431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:31.800431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:31.800607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.800607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.800607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.800607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.801099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.801563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.802488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.802488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.802767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.803584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:31.804858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:31.805358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:31.873366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:31.882377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:31.884109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:31.885260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dbed22a2-71e1-4995-813d-346caed3e7a8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097499 Aug 24 16:06:31.885822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1301/2630] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:31.959555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:31.968095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-519e95cd-386e-41c2-9d0d-049e5114d4ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.176650 Aug 24 16:06:31.968655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1330/2631] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:32.810764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:32.811326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:32.812222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:32.812843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:32.818100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:32.818590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:32.819022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:32.820100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:32.820378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:32.820836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:32.821262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:32.821372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:32.821768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:32.822434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:32.822902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:32.823332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:33.026571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:33.029885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:33.036488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5e801ad7-fd62-432b-b676-730da38af4ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.229454 Aug 24 16:06:33.037488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1302/2632] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:33.039977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e8d64b5c-71c9-426f-ad7b-62943f8aff92 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.231296 Aug 24 16:06:33.043745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:33.044773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:33.051804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:33.052503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1331/2633] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:32 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:33.053017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:33.054310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:33.055906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:33.056471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:33.056976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:33.063781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:33.063781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:33.069398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:33.070485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:33.071337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:33.072129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:33.072794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:33.073240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:33.141898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:33.153591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:33.156014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:33.157186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-daccaa94-be23-4313-935f-c05a8c3584a6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.118514 Aug 24 16:06:33.157744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1303/2634] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:33.235079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:33.244043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4e76670c-ead4-432f-8bb3-a01d6a2d06d5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.190376 Aug 24 16:06:33.244634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1332/2635] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:34.061223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:34.061931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:34.064944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:34.065708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:34.068388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.068871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.069861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.070559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.071008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.071426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.073253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.073877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.074328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.075038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.075503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.075985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.278335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:34.282529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:34.286500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2e687c40-cc13-4383-b36c-bdf26c1b86d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.229207 Aug 24 16:06:34.287072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1304/2636] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:34.291344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d87b45d8-5513-40b7-a911-66d15d31a08e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.230149 Aug 24 16:06:34.291861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:34.292468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:34.298407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.298887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.299315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.300100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.300546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.300963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.304166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1333/2637] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:34 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:34.305594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:34.309700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:34.310316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:34.316285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.316785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.317229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.317928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:34.318389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:34.318818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:34.371215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:34.380174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:34.381677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:34.383646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c8b49c13-ae3c-424c-969e-3069220c5398 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095659 Aug 24 16:06:34.384252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1305/2638] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:34.468516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:34.476920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e314b51-6d1a-4c47-8117-3bfa2893c7fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.171244 Aug 24 16:06:34.477494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1334/2639] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:35.309405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:35.310410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:35.316486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:35.317695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:35.320802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.321598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.322311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.323428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.324209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.324921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.328324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.329124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.329840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.330966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.331620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.332134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.565222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:35.568445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:35.574760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9e1e9f12-7c76-4885-8362-4c6aa28adc92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.270635 Aug 24 16:06:35.575439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1306/2640] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:35.577635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-33eaf489-bf93-43c9-b4be-877f9cd18c2c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.267622 Aug 24 16:06:35.578350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1335/2641] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:35 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:35.580599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:35.581208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:35.582610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:35.583463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:35.588312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.588811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.589255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.589962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.590422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.590850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.592704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.593380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.593827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.594523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:35.594982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:35.595407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:35.676597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:35.686058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:35.687570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:35.688742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-932b315f-8807-4c74-a331-144d7347820d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.112363 Aug 24 16:06:35.689297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1307/2642] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:35.743817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:35.751978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6ee1de53-288c-4b9e-a85c-22f3984dc7f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.172760 Aug 24 16:06:35.752544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1336/2643] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:36.596985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:36.597546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:36.604640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.605123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.605547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.606254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.606685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.606978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:36.607424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.607592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:36.613997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.614479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.614920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.615609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.616092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.616787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.805253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:36.808893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:36.813546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9ae667bc-c000-4287-b3c7-286b8eced70a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220504 Aug 24 16:06:36.814310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1308/2644] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:36.817594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-232dc05d-14c9-4075-a495-343c72376c9c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.214475 Aug 24 16:06:36.818288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1337/2645] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:36 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:36.824031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:36.824694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:36.829771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:36.830444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:36.836813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.837147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.837296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.837679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.837809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.838118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.838420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.838822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:36.838952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.839280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.839404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:36.839780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:36.929915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:36.945073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:36.948522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:36.951250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-725d1937-3936-4075-867a-bbf4699fb3d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.135577 Aug 24 16:06:36.952061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1309/2646] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:37.002125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:37.010318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-888fed4f-4928-4fc0-920b-86b0e612e684 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.191189 Aug 24 16:06:37.010883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1338/2647] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:37.838950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:37.839591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:37.846350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:37.846894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:37.846995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:37.847364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:37.847870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:37.848725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:37.849031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:37.849814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:37.854021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:37.854510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:37.854943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:37.855659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:37.856127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:37.856546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:38.059688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:38.063004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:38.068106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc83f15d-ced6-4333-90d9-6a97cbde9c51 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.235608 Aug 24 16:06:38.068683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1310/2648] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:38.073177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5c909f59-f61f-4526-a61e-287aa2a59902 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.236369 Aug 24 16:06:38.081942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1339/2649] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:37 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:38.082151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:38.082151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:38.082356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:38.082356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:38.082546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:38.082546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:38.082546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:38.085823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:38.086295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:38.086585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:38.086741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:38.087192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:38.087651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:38.088341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:38.088792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:38.089275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:38.171363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:38.181005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:38.182524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:38.183720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d49a6ffe-7690-4b26-9faf-9bc29a614284 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.114044 Aug 24 16:06:38.184496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1311/2650] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:38.248774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:38.252156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:38.258345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d25f914-c429-43f9-9468-6a8ac406f671 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.183626 Aug 24 16:06:38.258909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1340/2651] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:39.091491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:39.092147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:39.095211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:39.096042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:39.099060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.099522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.100003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.101690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.102269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.102704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.104058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.104614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.104981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.105950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.106273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.106694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.320783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:39.325652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:39.330780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-316a0608-3601-4293-a637-f56db99a5885 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.243220 Aug 24 16:06:39.331376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1312/2652] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:39.336054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e2c7e40-45e2-4f6f-8e79-cbf143e6e568 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.244370 Aug 24 16:06:39.345894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1341/2653] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:39 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:39.346114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:39.346114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:39.346312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:39.346312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:39.346477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.346477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.346477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.346477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.346798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.346798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.347653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.348151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.348592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.349343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:39.349756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:39.350189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:39.435771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:39.447222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:39.448741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:39.449933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e8b72259-7b55-4db5-a0d5-4c52012ec655 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.117576 Aug 24 16:06:39.450574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1313/2654] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:39.513157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:39.521236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f279d94e-c7f1-4808-9884-c46f28e0bce0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.183674 Aug 24 16:06:39.521800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1342/2655] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:40.353362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:40.353971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:40.357615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:40.358268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:40.360703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.361295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.361943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.362650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.363106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.363898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.364762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.365245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.365682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.366639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.367220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.367663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.563410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:40.566385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:40.573154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-70f69edb-15bf-4aed-b7c5-9e13558de064 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.224232 Aug 24 16:06:40.583835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1314/2656] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:40.584047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ca9a111c-3203-4d22-8c39-83c21061a897 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221701 Aug 24 16:06:40.584047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1343/2657] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:40 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:40.584249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:40.584249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:40.584557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:40.584557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:40.589510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.589510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.589510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.589839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.589946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.590034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.590129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.590215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.590313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.590412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:40.590412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:40.590412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:40.672967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:40.682987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:40.684508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:40.685730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-185b0542-4569-40e8-8828-9fc8294e173a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.111066 Aug 24 16:06:40.700574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1315/2658] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:40.747107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:40.756111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-41863f4f-16d3-43ed-8a39-0f746c3749af tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.179193 Aug 24 16:06:40.756956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1344/2659] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:41.597096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:41.597782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:41.597782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:41.598222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:41.604915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.605104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.605419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.605567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.605859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.605987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.606564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.607025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.607455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.609554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.610067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.610599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.805499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:41.809411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:41.814194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-74d2a551-56d3-4282-a131-cc68d3b548d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220930 Aug 24 16:06:41.815079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1345/2660] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:41.818205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4138617b-4109-4c50-9933-5419fa86f20c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.224946 Aug 24 16:06:41.829462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1316/2661] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:41 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:41.829980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:41.829980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:41.830364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:41.830546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=98 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:41.830688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:41.830807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.830807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.830807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.830807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.834105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.837195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.837524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.837978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.838112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.839292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:41.840010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:41.840444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:41.926339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:41.935143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:41.936655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:41.937825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e13bdb60-49b0-4b53-8336-3fd7cbeefbbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.121968 Aug 24 16:06:41.938374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1346/2662] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:41.996157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:42.005845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2910d17d-d222-428a-9096-60c2c132e659 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.184101 Aug 24 16:06:42.006909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1317/2663] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:42.839206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:42.839849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:42.846525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:42.847002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:42.847572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:42.847940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:42.848404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:42.848576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:42.848734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:42.848994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:42.855952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:42.856443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:42.856882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:42.857585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:42.858046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:42.858476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:43.053461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:43.058166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:43.063298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b501995f-9ad1-4f34-901c-0667db5841b4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.227681 Aug 24 16:06:43.063298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1347/2664] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:43.067384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-50aca602-ee12-4019-8d84-fab708cb9205 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.223215 Aug 24 16:06:43.067547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1318/2665] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:42 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:43.074099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:43.074707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:43.079390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:43.080023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:43.082388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=98 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:43.084424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:43.085686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:43.086251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:43.086968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:43.087387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:43.087506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:43.087877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:43.088016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:43.088331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:43.089033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:43.089536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:43.089911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:43.175046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:43.184976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:43.186512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:43.187682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-af59d5f2-e571-41b6-af1c-d723d06a9153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.123772 Aug 24 16:06:43.188238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1348/2666] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:43.249635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:43.258008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-667b2520-f0f2-4542-ad3f-4695003ffd4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.189521 Aug 24 16:06:43.258567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1319/2667] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:44.085976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.086649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.091671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.092434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.093142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.093623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.094052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.094736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.095191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.095685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.098842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.099272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.099737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.100655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.101142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.101575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.297471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.300288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.307067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d0899043-fd87-4220-89c7-7b25bb3f681a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225208 Aug 24 16:06:44.307670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1349/2668] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:44.309561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-76dad4cb-8e11-4221-a961-8a6f1183a92c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221706 Aug 24 16:06:44.319889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1320/2669] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:44 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:44.320095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.320095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.320270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.320270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.320483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.320693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.321380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.322319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.322784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.323217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.323675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.324173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.324615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.325314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.325772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.326201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.392101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.401033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.402533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.403715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5315612f-5b26-4a34-9687-7652a4aca1ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095095 Aug 24 16:06:44.404280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1350/2670] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:44.478793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.482207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:44.488114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-380f0313-6f8d-40db-9703-122a91d1ff23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.176903 Aug 24 16:06:44.488688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1321/2671] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:44.596967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.597572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.604381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.604946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.605461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.606228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.606790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.607287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] HTTP exception thrown: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Request method failure captured: Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: DELETE /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa HTTP/1.1 Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf2xh-C1tFdiRt6FNZ5-FZgYhUh1suuo-ZiAQtKZc9vdNUJNh-ykM8-K9i9E8UsDkqPFnCLky4sQfFcRW5j83MuyvXMSfyH8Tq5arIZcIjWG6m3_iN5vpOz046PZgiKoAyLivIA4mPmk0t3vSMIi755nXyEP4OlpP5jAa7IjSAE8nc Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:06:44.632900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 38f7d31cf0f541f58af7d3d850af6472 Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.634467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'aecbec13-9cc8-431d-b58e-61f8f2a845aa'} Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:06:44.635323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.637164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.638555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Returning 404 to user: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:06:44.638555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc4923fb-119d-47ea-845f-67b0fe48308c tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 404 len: 111 microversion: 2.1 time: 0.031350 Aug 24 16:06:44.638555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1351/2672] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:06:44 2022] DELETE /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:06:44.638777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.638777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: aecbec13-9cc8-431d-b58e-61f8f2a845aa] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.640214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.640667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.640844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.641289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.642656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.643383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.643883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.644321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.649405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.649969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.650559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.651305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.651789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.652241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.660008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] HTTP exception thrown: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Request method failure captured: Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa HTTP/1.1 Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf2xh-C1tFdiRt6FNZ5-FZgYhUh1suuo-ZiAQtKZc9vdNUJNh-ykM8-K9i9E8UsDkqPFnCLky4sQfFcRW5j83MuyvXMSfyH8Tq5arIZcIjWG6m3_iN5vpOz046PZgiKoAyLivIA4mPmk0t3vSMIi755nXyEP4OlpP5jAa7IjSAE8nc Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:06:44.661675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 38f7d31cf0f541f58af7d3d850af6472 Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.663922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'aecbec13-9cc8-431d-b58e-61f8f2a845aa'} Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:06:44.665269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. Aug 24 16:06:44.667007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:06:44.668652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Returning 404 to user: Instance aecbec13-9cc8-431d-b58e-61f8f2a845aa could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:06:44.668652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0ca34aa1-66e8-48fe-928c-0ee1c31716d7 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa" status: 404 len: 111 microversion: 2.1 time: 0.034780 Aug 24 16:06:44.668652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1322/2673] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:44 2022] GET /compute/v2.1/servers/aecbec13-9cc8-431d-b58e-61f8f2a845aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:06:44.679173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:06:44.759986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-28a3f280-83c8-45a3-a531-4f8d581d7eb1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 204 len: 0 microversion: 2.1 time: 0.125010 Aug 24 16:06:44.760339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1352/2674] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:06:44 2022] DELETE /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:06:44.769853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:44.770673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:44.777483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.777963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.778402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.779086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:44.779541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:44.780004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:44.915246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:44.924053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3e737f88-3a8c-482c-85b4-c7197176d11c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.159139 Aug 24 16:06:44.924646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1323/2675] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:45.329634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:45.330256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:45.333438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:45.334050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:45.338006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.338501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.338948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.339661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.340201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.340486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.340618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.340963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.341395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.342096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.342536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.342957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.544342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:45.547038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:45.552676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90edfca0-2124-44b3-8bdb-18f74bbc75e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.227294 Aug 24 16:06:45.554118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1353/2676] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:45.555944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-41b27dc5-d2a0-4e34-a5d7-5c24f182e304 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.226333 Aug 24 16:06:45.558802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:45.559166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1324/2677] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:45 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:45.559993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:45.566263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:45.566665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.566879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:45.567576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.568265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.569620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.570041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.570469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.574026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.574521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.574959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.575675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.576126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.576551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.641360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:45.651114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:45.652649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:45.653829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a943783b-2de8-4441-9410-afab37f94750 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098783 Aug 24 16:06:45.654578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1354/2678] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:45.728043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:45.736327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5bfe0623-aa03-45c7-876c-e92eafd6efc0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.176087 Aug 24 16:06:45.736889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1325/2679] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:45.946555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:45.947097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:45.953039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.953524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.953972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:45.954651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:45.955104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:45.955520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.089880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.097901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8932c7c6-2053-4a37-b393-5abc73ec33d4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.155851 Aug 24 16:06:46.098493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1355/2680] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:46.575146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:46.575818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:46.576639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:46.577258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:46.582629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.583100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.583537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.584179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.584319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.584689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.584799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.585117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.585264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.585846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.586306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.586732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.604989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:46.778657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.785640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.786949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05c88488-d79d-474c-8c29-4cdc16cb6982 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215814 Aug 24 16:06:46.788076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1326/2681] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:46.792783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:46.793442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:46.794602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d27c3a13-e0d0-47a6-803a-fbaade72379a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221724 Aug 24 16:06:46.795363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1356/2682] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:46 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:46.799896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.800324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:46.800481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.800801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.801492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.801736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:46.801943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.802369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.808924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.809417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.809875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.810570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:46.811018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:46.811435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:46.890103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.899158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.900693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.901829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fd230a92-7869-4e82-847c-62994a0a4455 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.112622 Aug 24 16:06:46.902387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1327/2683] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:46.983582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:46.992739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa3f9f6c-ee8d-4941-b391-08f716a04615 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.196161 Aug 24 16:06:46.993306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1357/2684] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:47.119123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:47.119683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:47.125659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:47.126146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:47.126581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:47.127272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:47.127755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:47.128188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:47.264777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:47.273993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b50f1665-7bbf-4373-8b65-149d0f06b69e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158852 Aug 24 16:06:47.274558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1328/2685] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:47.809747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:47.810290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:47.816922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:47.817332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:47.817757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:47.818510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:47.819971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:47.820409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:47.821306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:47.821925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:47.828691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:47.829176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:47.829678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:47.830386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:47.830869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:47.831291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.011366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.018303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.019599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-04c54a98-0b0d-4809-a233-09e058794c14 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.202878 Aug 24 16:06:48.020397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1329/2686] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:47 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:48.024729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:48.025337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:48.027093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3db7d855-822b-4797-9ce4-c73c9f03a5f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221053 Aug 24 16:06:48.028607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1358/2687] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:48.033760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:48.034438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:48.041172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:48.041631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:48.041939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.042974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:48.043431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:48.043887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.044163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:48.044453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:48.045176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.045888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:48.046344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:48.046770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.346623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.355336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.356871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.358011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ea352627-cf65-4975-b2ad-0ae7962c13fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.336871 Aug 24 16:06:48.359211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1330/2688] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:48.362890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:48.363498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:48.369567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:48.370052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:48.370561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.371326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:48.371882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:48.372355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:48.478856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.487231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-baffbbd6-9157-4963-8d5c-6fcb9e3da0f3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.457828 Aug 24 16:06:48.487849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1359/2689] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:48.527372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:48.535766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-858e5303-e39e-4769-a30d-866c9d813553 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.176259 Aug 24 16:06:48.536329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1331/2690] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:49.041990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:49.042597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:49.049060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.049540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.049972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.050105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:49.050639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:49.050753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.051096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.051517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.057350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.057829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.058268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.058962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.059413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.059868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.250363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.253188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.260997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e549536e-b2e2-4110-8d94-166e05241266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222820 Aug 24 16:06:49.261639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1360/2691] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:49 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:49.265351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9c3f627-a433-4cdc-b4d8-ecef00c5e83e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218966 Aug 24 16:06:49.265921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1332/2692] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:49.381781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:49.382499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:49.388518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.389009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.389450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.390147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.390607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.391039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.451852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.461020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.462531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.463694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a3902bee-6c60-4ddf-bb18-47bb12d23b2b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086413 Aug 24 16:06:49.464249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1361/2693] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:49.510697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:49.510963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:49.517580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.519034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.519034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.519255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.519643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.520072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.562176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:49.562899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:49.570221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.571203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.572101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.573441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:49.574205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:49.574636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:49.694932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.703343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-37053378-eba5-4170-b4ae-cf474abbf91c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.198177 Aug 24 16:06:49.703901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1333/2694] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:49.738955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:49.747895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6abc8049-1402-470d-8e5c-b88fc2596583 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.189516 Aug 24 16:06:49.748466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1362/2695] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:50.286595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:50.287910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:50.288765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:50.289388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:50.294475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.294957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.295389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.295808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.296102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.296302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.296550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.296742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.296971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.297440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.297901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.298355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.491026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.495710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.500135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-39aef694-f877-4aed-a064-7ca3476b8f2a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.217405 Aug 24 16:06:50.500718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1334/2696] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:50 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:50.504615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2bf61dfc-1384-4f6d-9458-0bdd1067ebdf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220767 Aug 24 16:06:50.507707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:50.507707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:50.507938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1363/2697] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:50.512689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.513165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.513592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.514275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.514718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.515134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.577413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.587094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.588649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.589788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dd218fde-a25e-4662-b81a-2ff600e41289 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088164 Aug 24 16:06:50.590339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1335/2698] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:50.727023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:50.727647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:50.733706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.734194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.734631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.735330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.735820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.736249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.768508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:50.769297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:50.776806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.777303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.777742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.778452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:50.778945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:50.779375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:50.932391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.940811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54d2bbed-a49a-4101-9e82-29514d32d699 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.217794 Aug 24 16:06:50.941492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1364/2699] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:50.961113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:50.969610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-655aa594-5670-44ac-9a5d-6a42780bf134 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.204871 Aug 24 16:06:50.970204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1336/2700] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:51.523578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:51.524231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:51.526431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:51.527040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:51.530977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.531473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.531952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.532654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.533106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.533532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.533652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.534050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.534484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.535172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.535682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.536080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.731101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:51.734777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:51.740551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6fdfd3c3-74dc-4541-888d-79107eebdfd9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220533 Aug 24 16:06:51.741401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1365/2701] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:51 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:51.743078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d40401d9-e94a-4d93-878b-979b02747412 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220381 Aug 24 16:06:51.743670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1337/2702] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:51.745848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:51.746458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:51.752335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.753032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.753465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.754334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.754807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.755214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.816658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:51.825625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:51.827130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:51.828302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de689d47-1eb3-4656-9535-86f60e1d2739 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085983 Aug 24 16:06:51.828860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1366/2703] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:51.963884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:51.964497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:51.970543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.971033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.971473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.972208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.972662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.973089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.990556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:51.991272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:51.997285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.997773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.998270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:51.998941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:51.999420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:51.999883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:52.173721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:52.177071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:52.183088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-237cae11-4324-4e82-8734-7ac75064ee1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224215 Aug 24 16:06:52.183686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1338/2704] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:52.186873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-87105523-8e20-4ab3-aa5c-b0feaf307d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.200108 Aug 24 16:06:52.187514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1367/2705] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:52.761694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:52.762227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:52.764693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:52.765321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:52.768786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:52.769274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:52.769713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:52.770411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:52.770865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:52.771963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:52.772628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:52.773254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:52.773697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:52.774403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:52.774867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:52.775300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:52.776444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:52.971821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:52.975875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:52.980338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9f19fe5e-080d-4574-985f-b400193f5d6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222681 Aug 24 16:06:52.980913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1339/2706] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:52 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:52.984648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d8cb5cba-e303-412c-9064-ff97c62fccd3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223737 Aug 24 16:06:52.985307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1368/2707] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:52.985461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:52.986285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:52.992282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:52.992756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:52.993185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:52.993863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:52.994311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:52.994730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:53.058234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:53.066824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:53.069089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:53.070222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ad4925cd-896f-4da0-b111-e534d04a9aa8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088409 Aug 24 16:06:53.070801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1340/2708] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:53.206281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:53.207071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:53.208816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:53.209435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:53.214492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:53.214981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:53.215341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:53.215466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:53.215865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:53.216159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:53.216301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:53.216619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:53.217002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:53.217125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:53.217459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:53.217885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:53.415174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:53.418296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:53.423567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-652a512c-7fd0-43af-b929-6cbaf1484f74 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219047 Aug 24 16:06:53.424169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1341/2709] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:53.426544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-65039806-cb0b-4f08-8466-7c80e4bc156f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224664 Aug 24 16:06:53.427109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1369/2710] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:54.006025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:54.006630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:54.009016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:54.009756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:54.013989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.014357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.014793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.015509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.015960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.016263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.016375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.016751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.017189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.017880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.018360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.018787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.210522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.217463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.220365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-733e5838-37c1-4cd7-8754-9334f3e1d45a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218250 Aug 24 16:06:54.220947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1342/2711] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:54.225641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:54.226060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a962aaab-8932-4cba-ac6c-8b39b5f2e152 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221067 Aug 24 16:06:54.226239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:54.226763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1370/2712] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:54 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:54.232451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.232931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.233366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.234055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.234504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.234921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.297678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.306615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.308153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.309291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2496e636-d426-49e0-af51-82aa286760a2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087443 Aug 24 16:06:54.309844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1343/2713] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:54.446081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:54.446698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:54.448017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:54.448627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:54.452766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.453260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.453698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.454398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.454522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.454859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.454969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.455297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.455416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.456084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:54.456532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:54.456992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:54.657211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.661298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:54.665525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0dca0486-5e3c-41fd-a720-41985801358d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224224 Aug 24 16:06:54.666096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1371/2714] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:54.669872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05ad32c4-08ad-443c-bd3f-66adbddd3da4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225822 Aug 24 16:06:54.670521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1344/2715] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:55.242922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:55.243678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:55.248507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:55.249556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:55.250352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.250860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.251294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.252016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.252469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.252892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.255787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.256299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.256739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.257443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.257898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.258331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.449427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.454014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.458075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-555a8b2b-38ee-4d26-a03d-dc826ac001a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219807 Aug 24 16:06:55.459287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1372/2716] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:55.463308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a52d5e9-1f0b-44f0-be59-a6c33e806f6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.218585 Aug 24 16:06:55.464053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1345/2717] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:55 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:55.464247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:55.464917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:55.470767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.471252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.471724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.472421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.472868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.473356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.478002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:55.534783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.544061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.545561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.546706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8284d05e-ae91-4653-9ce3-9e2e95b18c42 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086474 Aug 24 16:06:55.547420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1373/2718] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:55.687913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:55.688561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:55.691420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:55.692090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:55.696028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.696522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.696960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.697665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.698123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.698423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.698549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.698905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.699339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.700051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:55.700505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:55.700924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:55.898260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.901928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:55.906804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2a8d622-a5a9-4628-9948-0cffd9c59f8b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222726 Aug 24 16:06:55.907576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1346/2719] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:55.910515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-efd5894f-54ad-4a33-9460-e5cd723a1b98 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222929 Aug 24 16:06:55.911298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1374/2720] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:56.480305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:56.480926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:56.484045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:56.484852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:56.487829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.488330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.488790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.489492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.490515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.490948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.493663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.494148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.494580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.495274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.495751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.496176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.687748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:56.691968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:56.696618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b35e49d7-1aaa-46e3-9958-0c97947798a1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219928 Aug 24 16:06:56.696964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1347/2721] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:56.701095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-18c7df14-21db-4e9e-a8e4-7626f02e4c9f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220981 Aug 24 16:06:56.701363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:56.701664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1375/2722] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:56 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:56.702159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:56.708197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.708924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.709450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.709900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.710350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.710769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.771994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:56.780594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:56.782102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:56.783225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0182bd3b-7a3d-47f3-880e-b28e82ffe8c8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085358 Aug 24 16:06:56.783793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1348/2723] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:56.929029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:56.929640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:56.931714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:56.932352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:56.935763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.936250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.936679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.937372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.937820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.938189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.938317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.938802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.939186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:56.939929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:56.940385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:56.940812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.137567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:57.144339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:57.146464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0b5de014-9fe0-476b-b6c5-fbf385064e4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221106 Aug 24 16:06:57.147057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1376/2724] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:57.157779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ded4766c-c2c4-4d9f-9191-d630c61065d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.229653 Aug 24 16:06:57.158361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1349/2725] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:57.722214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:57.722722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:57.730240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:57.730732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:57.731166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.731898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:57.732355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:57.732779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.874483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:57.883611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-476df307-b72e-4043-9609-990c91a486d8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.165149 Aug 24 16:06:57.884233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1350/2726] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:57.888783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:57.889387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:57.893914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:57.894538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:57.895777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:57.896591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:57.897051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.897836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:57.898291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:57.898845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.902075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:57.902568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:57.903228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.903986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:57.904447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:57.904874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:57.986682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:57.996480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:57.997992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:57.999139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-423faed1-92b8-4020-bd67-902c98cc1e44 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.113998 Aug 24 16:06:57.999722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1351/2727] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:06:58.059118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:58.067335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6c3dd54f-e8cc-418d-a062-c66d53cd73d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.352921 Aug 24 16:06:58.068047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1377/2728] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:58.168168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:58.168780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:58.174773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:58.175259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:58.175715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:58.176409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:58.176862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:58.177849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:58.181109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:58.181797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:58.187687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:58.188172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:58.188598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:58.189284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:58.189732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:58.190181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:58.372230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:58.384970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-06e2c8a9-c87c-4695-b40b-63b9d8b5cccd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220654 Aug 24 16:06:58.385184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:58.385559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1352/2729] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:58.393638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e628fcd-8615-4bc7-bdad-8ed01f672971 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.217155 Aug 24 16:06:58.394200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1378/2730] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:58.906077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:58.906664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:58.913684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:58.914157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:58.914592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:58.915274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:58.915758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:58.916179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.022033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:59.022643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:59.030873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.031374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.031851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.033234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.033701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.034134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.065305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.074231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3d32483b-4a38-4475-a348-f62a556f4331 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.171964 Aug 24 16:06:59.074812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1353/2731] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:58 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:59.089486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:59.090095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:59.096170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.096658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.097094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.097790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.098237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.098664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.100946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.110002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.111503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.112693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22cfb675-2dcf-415d-8791-c64b8f70ca4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.094656 Aug 24 16:06:59.113258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1379/2732] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:06:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:06:59.230378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.238718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0611c576-b648-4203-a9ca-6194dd95db0d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153121 Aug 24 16:06:59.239284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1354/2733] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:06:59.406437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:59.407055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:59.413935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.414432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.414805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:06:59.414934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.415422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:06:59.415559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.416029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.416456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.421416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.421903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.422345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.423035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:06:59.423483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:06:59.423934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:06:59.614321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.617926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:06:59.621450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:06:59.623403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-027d50fd-5be1-43cd-a652-3f3b0af7fd93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220744 Aug 24 16:06:59.624507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1380/2734] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:06:59.627830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-28c1140b-6cd3-45a6-9871-150ab33cb8bd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.217333 Aug 24 16:06:59.628413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1355/2735] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:06:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:00.097522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:00.098224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:00.105900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.106412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.106858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.107591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.108359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.108841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.137257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:00.137870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:00.144804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.145300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.145730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.146676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.147141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.147581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.221591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.232331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.234023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.235184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0439945f-03bc-4727-b302-8001a15519d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.102180 Aug 24 16:07:00.235765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1356/2736] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:00.260292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:00.260926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:00.266986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.267478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.267959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.268666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.269222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.269547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.283283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.292173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f3960f9f-dcd5-4df1-93f0-7a4ebba2691a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.198473 Aug 24 16:07:00.292989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1381/2737] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:00 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:00.404465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.413645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9b4f1cef-1bf5-43fc-9c1c-20743f79dcc9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157270 Aug 24 16:07:00.414211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1357/2738] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:00.645159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:00.646509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:00.650058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:00.650674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:00.653056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.653560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.654000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.654703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.655157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.655590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.656845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.657354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.657787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.658524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:00.658925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:00.659350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:00.853313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.860933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:00.861720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e0fa4112-1c7f-45c3-82bf-e41bcf8fd85f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.216192 Aug 24 16:07:00.862302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1358/2739] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:00.870139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-db6bced3-f92c-4f9a-9444-0bd58bb29547 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228747 Aug 24 16:07:00.870814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1382/2740] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:01.266214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:01.266831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:01.274051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.274544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.274989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.275728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.276183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.276612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.315139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:01.315864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:01.323316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.323839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.324288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.325016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.325483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.325916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.351719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:01.360993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:01.362557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:01.363731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-846b6e15-880d-4ece-a4fb-507f328eac1e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101542 Aug 24 16:07:01.364289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1359/2741] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:01.435119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:01.435759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:01.441814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.442306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.442752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.444048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.444512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.444943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.465972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:01.474881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5d0cdcd8-17aa-4a40-bda1-8b65801844c9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.163160 Aug 24 16:07:01.475368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1383/2742] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:01 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:01.574881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:01.585587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b705622c-1300-4c92-9179-3c6be932a28a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154356 Aug 24 16:07:01.586167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1360/2743] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:01.890894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:01.891430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:01.891571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:01.892194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:01.898550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.898949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.899106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.899448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.899582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.899975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.900263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.900682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:01.900815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.901140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:01.901262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:01.901568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.109331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.118587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-80b104bc-5d3e-4612-9718-618004921059 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.237042 Aug 24 16:07:02.119166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1384/2744] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:02.120702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.129043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1b967272-ff2b-4af2-b344-1d6204b255cb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.242039 Aug 24 16:07:02.129621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1361/2745] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:02.387497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:02.388149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:02.394567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:02.395055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:02.395495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.396456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:02.396917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:02.397348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.462022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.470901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.472427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.473576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5ccf3bcf-dfdc-479e-9dda-e080dcc63efd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090046 Aug 24 16:07:02.474646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1385/2746] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:02.496519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:02.497139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:02.503522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:02.504041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:02.504475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.505234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:02.505749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:02.506231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.608325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:02.609019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:02.615901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:02.616288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:02.616735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.617585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:02.618044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:02.618469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:02.642786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.651919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d060510b-f431-4c75-8084-d66e71438c1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159173 Aug 24 16:07:02.652501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1362/2747] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:02.749221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:02.757866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-579be21d-44f0-4259-87e3-ae1e4c7f894b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153358 Aug 24 16:07:02.758437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1386/2748] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:03.140877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:03.141495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:03.148561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.149047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.149507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.150200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.150650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.151096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.151365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:03.152010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:03.158346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.158840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.159284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.160019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.160476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.160903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.353196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.357740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.361489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f76a84b0-c072-4710-bb22-8d36f0ef51d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224462 Aug 24 16:07:03.362062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1363/2749] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:03.366527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-80e6895c-309e-472a-b2f4-420c03d9f169 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218994 Aug 24 16:07:03.367179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1387/2750] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:03.447573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:07:03.448255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:07:03.623759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:03.624615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:03.631134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.631830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.632273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.632988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.633451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.633837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.673721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:03.674335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:03.681457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.681943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.682378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.683076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.683529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.683979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.702929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.712144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.713726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.714935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2a5ec6b-5d32-41e0-bfe7-c782a0650a3b tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.222455 Aug 24 16:07:03.715489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1364/2751] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:07:03.779417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:03.780056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:03.786518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.787244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.787611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.788388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:03.788876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:03.789304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:03.814436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.823841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e44187e7-6ef7-485a-9212-e8e630827174 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153925 Aug 24 16:07:03.824607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1388/2752] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:03 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:03.923604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:03.933036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b0d79d36-ae68-48df-814a-c2f421f722a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157344 Aug 24 16:07:03.933649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1365/2753] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:04.384553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:04.385167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:04.387349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:04.387990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:04.391242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.391768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.392215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.392938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.393415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.393827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.394002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.394489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.394931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.396255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.397389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.397800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.592779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:04.596275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:04.596492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:04.603500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1f19fc17-52e4-4434-899e-19afff36aa95 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222962 Aug 24 16:07:04.604109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1389/2754] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:04.606512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d98ff459-d9d4-41f4-99be-2a2eb6f938e1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222919 Aug 24 16:07:04.607231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1366/2755] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:04.737340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:04.737947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:04.745172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.745657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.746097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.746791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.747248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.747692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.812391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:04.821566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:04.823079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:04.824258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-508d21b1-aedd-463b-a1bd-0ebc91e6d596 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091060 Aug 24 16:07:04.824820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1390/2756] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:04.845278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:04.845893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:04.851981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.852459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.852892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.853576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.854026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.854446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.954314 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:04.954931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:04.962001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.962495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.962937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.963656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:04.964116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:04.964763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:04.987512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.000911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-10e3a6d6-dfcf-4869-917b-2a2291dbcd58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.159388 Aug 24 16:07:05.001488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1367/2757] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:05.097659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.106048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fc871033-7bb6-4e46-a6ba-4822e4dd6130 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155641 Aug 24 16:07:05.106658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1391/2758] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:05.625091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:05.625725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:05.628171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:05.628800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:05.633145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:05.633634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:05.634137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:05.634803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:05.635200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:05.635644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:05.637166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:05.640158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:05.640605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:05.641325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:05.641782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:05.642204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:05.834933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.837961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.843482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6a9f79a2-af16-42b9-ad3e-2c66e42d94bf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222182 Aug 24 16:07:05.844099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1368/2759] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:05.850104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:05.850656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:05.852473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:05.857846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:05.858314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:05.858749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:05.859449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:05.859928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:05.860353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:05.861890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e05df081-1226-44a7-b97f-ee102183b304 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.237530 Aug 24 16:07:05.862505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1392/2760] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:05.927158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.935805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.937286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:05.938412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-01730569-f519-4f9d-b417-bcc61fe054a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092851 Aug 24 16:07:05.938963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1369/2761] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:06.023050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:06.023706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:06.025712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:06.031090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.031577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.032053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.032745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.033205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.033630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.127609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:06.128168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:06.135094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.135588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.136056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.136774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.137237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.137667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.466616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:06.470567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:06.476924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9a84cec2-0d6b-4d85-97b9-a869e5647bd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.458383 Aug 24 16:07:06.478105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1393/2762] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:06 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:06.479652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-65633b2b-38d5-4c9f-9963-5ff2c2522cad tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.355952 Aug 24 16:07:06.480245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1370/2763] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:06.866946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:06.867549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:06.874027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.874502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.874930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.875605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.876097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.876547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.883221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:06.883880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:06.890387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.890871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.891309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:06.892033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:06.892494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:06.892922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.071591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.079907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-df558947-c938-495c-af3d-691ab7268695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.217229 Aug 24 16:07:07.080588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1394/2764] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:07.085751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:07.086357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:07.092493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:07.092973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:07.093413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.094199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:07.094571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:07.094995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.100823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.109205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-13d40e7d-92e8-4dca-bb8a-2d8fd88b98f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230494 Aug 24 16:07:07.109778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1371/2765] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:07.159137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.170624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.172154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.173285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1b7396a5-4d05-4846-b3da-01e15b21ca8f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091712 Aug 24 16:07:07.173837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1395/2766] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:07.501288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:07.501559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:07.501953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:07.502087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:07.508421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:07.508686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:07.509126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:07.509350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:07.509554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.509836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.510260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:07.510718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:07.510932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:07.511147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.511453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:07.512010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:07.531785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:07.705991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.710149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:07.715513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-081ac8b8-5a25-4444-b740-85310d8d1995 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.218024 Aug 24 16:07:07.716124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1372/2767] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:07 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:07.718248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-62432729-f48b-48de-bddd-0b8b0df9f4dd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220627 Aug 24 16:07:07.718808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1396/2768] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:08.102379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:08.102924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:08.109486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.109968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.110404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.111093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.111548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.112013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.131917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:08.132519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:08.139339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.139867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.140313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.141025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.141486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.141917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.323355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.326949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.332345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-19d0d0a3-9583-4f01-9e2a-4b40f48633f2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.233993 Aug 24 16:07:08.333262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1373/2769] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:08.336924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c5cf8e9d-7935-4f42-bafa-d95ce56fc88c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.209492 Aug 24 16:07:08.337731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1397/2770] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:08.338394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:08.339270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:08.345257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.345823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.346390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.347146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.347760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.348258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.416306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.425772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.427392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.429242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b89b39ee-ee19-45e3-8671-faac9190ff34 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.094739 Aug 24 16:07:08.429954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1374/2771] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:08.736794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:08.737402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:08.739448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:08.741070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:08.745333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.745736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.746168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.747177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.747305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.747435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.747547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.747817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.747947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.748967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:08.748967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:08.749360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:08.948484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.951803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:08.957316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90f3ec03-5194-4699-a2b4-96584854eb18 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.224170 Aug 24 16:07:08.958051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1398/2772] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:08 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:08.961493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e14a60a3-5e54-48a1-8a6e-35191ef60db7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226049 Aug 24 16:07:08.962053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1375/2773] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:09.354111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:09.354928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:09.361448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:09.362083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:09.362867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.363361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.363829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.364529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.365090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.365552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.368382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.368858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.369289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.369978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.370423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.370848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.559797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:09.562463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:09.570686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-90ae1933-319d-48de-906d-f4361727ed16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.220836 Aug 24 16:07:09.571273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1399/2774] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:09.572590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-06f2a24a-93ff-4d98-ab5b-25a84f821bcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215170 Aug 24 16:07:09.573316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1376/2775] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:09.575857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:09.576462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:09.582564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.583042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.583528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.584234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.584682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.585106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.648662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:09.657189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:09.658680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:09.659915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d15acb5-7449-471f-9135-b6295c7bbf1c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087604 Aug 24 16:07:09.660479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1400/2776] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:09.978912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:09.979441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:09.982026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:09.982643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:09.985702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.986197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.986637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.987346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.987831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.988263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.988466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.988957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.989396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:09.990149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:09.990932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:09.991315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.182222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.185534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.190510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2a90412c-2b0c-4e0c-9222-72669e41339b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.215955 Aug 24 16:07:10.191192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1377/2777] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:09 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:10.194834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d8a7b0d-f2b1-4589-9452-32d40822b3e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216534 Aug 24 16:07:10.195387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1401/2778] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:10.592044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:10.592644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:10.593973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:10.594586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:10.599399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:10.599399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:10.600328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.601065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:10.601379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:10.601504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:10.601882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:10.601997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.602323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.603070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:10.603532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:10.603988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.798396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.807603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-065d026f-5d05-47a6-a1ae-7bea38e72a4f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.219487 Aug 24 16:07:10.808190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1378/2779] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:10.810623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.813125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:10.813742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:10.819258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-64f13be3-0cb8-4554-83ff-ae93bba0f7d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.229018 Aug 24 16:07:10.827668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:10.827863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1402/2780] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:10.827982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:10.827982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.827982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:10.827982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:10.828322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:10.885931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.894482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.896160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:10.897672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-981dceb4-9433-48e8-ad68-75520871c334 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088483 Aug 24 16:07:10.898239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1379/2781] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:11.212767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:11.213373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:11.217326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:11.217973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:11.219537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.220057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.220488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.221178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.221623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.222040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.223856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.224913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.225349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.226037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.226490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.226915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.417350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:11.424026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:11.425818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c0f25a1d-982b-4ef9-b447-54f0c131ca66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.217344 Aug 24 16:07:11.426412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1403/2782] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:11 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:11.432715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-10a39d9c-7a37-41da-9cf0-472a7d73ee3a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219244 Aug 24 16:07:11.433273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1380/2783] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:11.830168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:11.830739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:11.837600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.838095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.838538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.839240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.839718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.840152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.842847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:11.843739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:11.853740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.854390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.854938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:11.855813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:11.856407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:11.856935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.044947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.048984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.053802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f0892f4-f946-4831-929a-00ee506d289f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.227686 Aug 24 16:07:12.054370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1404/2784] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:12.058571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2bad6e5-6276-445f-b36a-ce849c2cd841 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221261 Aug 24 16:07:12.058864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:12.059543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1381/2785] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:12.059725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:12.065232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:12.065714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:12.066150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.066838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:12.067286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:12.067732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.129555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.138871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.140411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.141531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4b6769cf-68b9-4b2b-a4ca-2e2abba9dacd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086263 Aug 24 16:07:12.142079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1405/2786] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:12.447593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:12.448242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:12.454014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:12.454357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:12.454631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:12.454848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:12.455285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.456010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:12.456463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:12.457145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.462014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:12.462512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:12.462950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.463673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:12.464139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:12.464566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:12.484459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:12.657363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.661362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:12.667393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7054cd6f-38de-4a0d-a7e1-d586778a27b1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216794 Aug 24 16:07:12.671700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1406/2787] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:12.671920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58e920ba-c145-4f3e-ad06-a642c0d9720c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.227249 Aug 24 16:07:12.671920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1382/2788] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:12 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:13.077071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:13.077814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:13.080556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:13.081175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:13.085152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.085648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.086092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.086797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.087256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.087845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.087970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.088374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.088806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.089490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.089941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.090366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.289713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.293353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.298258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-36fbc59b-e2a8-40da-8d6b-055f1c11dbd6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225235 Aug 24 16:07:13.298935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1407/2789] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:13.303843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:13.304461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:13.305703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f290b01a-ac15-4dff-9a1a-6f0c46714332 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228649 Aug 24 16:07:13.306537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1383/2790] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:13.310347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.310840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.311285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.312001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.312446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.312866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.376281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.386428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.388608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.389769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e37b115-aea8-4766-b146-9eeed467c533 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089906 Aug 24 16:07:13.390332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1408/2791] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:13.690075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:13.690680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:13.694299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:13.694914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:13.697856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.698338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.698884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.699457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.699936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.700351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.701264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.701753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.702189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.702880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:13.703392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:13.703848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:13.903807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.906835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:13.912221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5804877b-c141-495e-b7e5-02a48cdf0a57 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221988 Aug 24 16:07:13.912804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1409/2792] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:13 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:13.915142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f5c11772-e367-40f6-a5b3-190dc167a984 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.228893 Aug 24 16:07:13.915720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1384/2793] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:14.320868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:14.321465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:14.327644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.327841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:14.328271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.328393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:14.328576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.329276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.329733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.330169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.335098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.335565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.336028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.336722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.337168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.337585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.530769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:14.534012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:14.539910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f13867d1-8a96-4780-858a-387868d706c4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223645 Aug 24 16:07:14.540522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1410/2794] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:14.542975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-495e7c31-f5b3-4628-828d-292304c9bcba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218833 Aug 24 16:07:14.543660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1385/2795] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:14.544891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:14.545487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:14.551212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.551717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.552735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.553430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.553876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.554297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.616839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:14.625533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:14.627020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:14.628208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d2158e45-de0c-49c0-a012-effd8fc811c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086822 Aug 24 16:07:14.628756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1411/2796] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:14.933935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:14.934551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:14.936662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:14.937272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:14.941095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.941575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.942008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.942769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.943261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.943876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.943996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.944414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.944845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:14.945531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:14.945981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:14.946401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.140166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.144003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.150108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5b5f9c9b-ef55-4480-bb88-3d7daad5bd43 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220220 Aug 24 16:07:15.150696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1386/2797] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:14 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:15.153413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b649596d-fe7b-424a-b011-9eedb6fae843 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220416 Aug 24 16:07:15.153996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1412/2798] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:15.563174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:15.564271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:15.564404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:15.564939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:15.571681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:15.572176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:15.572367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:15.572618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.572862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:15.573299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.573413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:15.573769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:15.574003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:15.574215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.574463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:15.574889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.792401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.799843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.800984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3497624a-c5cc-4653-97b6-5338e2057b2b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.240389 Aug 24 16:07:15.801764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1413/2799] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:15.806147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:15.806749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:15.812868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:15.813381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:15.813768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.814587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:15.815054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:15.815476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:15.816125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-66cde7cd-4a02-4639-b06c-5cf5cd7c5d47 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.256797 Aug 24 16:07:15.816712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1387/2800] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:15.879351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.889157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.890672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:15.891848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-217f6cfb-c97c-433f-ac10-ea62dd8bf734 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089333 Aug 24 16:07:15.892411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1414/2801] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:16.171515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:16.172261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:16.174050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:16.174661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:16.178811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.179280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.179755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.180435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.180878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.181055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.181296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.181546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.182072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.182715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.183168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.183598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.379125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:16.383657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:16.388865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b6034c3-716c-41cd-8631-f1f908df69b3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221244 Aug 24 16:07:16.389647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1388/2802] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:16 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:16.392847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-03da5cae-294d-444c-8eea-e102db1c357e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221632 Aug 24 16:07:16.392847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1415/2803] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:16.822987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:16.823608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:16.829719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.830205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.830647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.831347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.832121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.832551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.837723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:16.838629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:16.839462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:16.845471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.846012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.846392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:16.847082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:16.847530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:16.847978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.047024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.050412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.056332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-55051e1c-e0ff-404b-9f0a-8d931f2c3d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.237248 Aug 24 16:07:17.057554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1389/2804] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:17.059490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3d7d79be-0c0a-4fea-b886-6d89afa9e6b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224647 Aug 24 16:07:17.060766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1416/2805] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:17.063395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:17.064856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:17.071310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:17.071842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:17.072282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.072990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:17.073442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:17.073871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.135913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.144639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.146994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.148167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-56ef84f9-aa6c-427d-882d-49aec732b413 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089267 Aug 24 16:07:17.148724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1390/2806] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:17.412313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:17.413044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:17.414318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:17.414938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:17.421296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:17.421539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:17.421782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:17.422195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:17.422338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.422652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.422940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:17.423340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:17.423453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:17.423838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.423970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:17.424349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:17.621473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.624506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:17.629789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a97c8668-268d-419d-8644-611563896643 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221884 Aug 24 16:07:17.631077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1417/2807] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:17.633354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b3d7a8e-4907-453c-bdc0-7c1c93801a33 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223040 Aug 24 16:07:17.633914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1391/2808] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:18.081036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:18.081952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:18.082314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:18.082452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:18.088032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.088518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.088665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.088950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.089131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.089484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.089628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.090078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.090208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.090501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.090633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.091035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.286036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.290535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.294956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-18873690-415c-4b52-a98e-49d965e9bbf9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217722 Aug 24 16:07:18.295753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1392/2809] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:18.299130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4beb5c53-8b00-4d00-a332-124a7cea02de tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.221906 Aug 24 16:07:18.307819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1418/2810] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:18.307996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:18.307996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:18.307996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.307996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.308372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.308775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.309231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.309660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.374164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.384374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.386112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.387352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-16105518-eafa-44fa-916a-a0780a50d301 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090879 Aug 24 16:07:18.387952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1393/2811] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:18.651966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:18.652574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:18.654187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:18.654808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:18.659114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.659608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.660077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.660772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.661304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.661425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.661744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.662081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.662721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.663425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:18.663926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:18.664360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:18.867660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.873301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:18.876080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-007d5678-b6cf-488a-8548-719baced52d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225607 Aug 24 16:07:18.876658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1394/2812] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:18.882897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-87a71613-6fd5-42be-973f-9c7e905f8979 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.234878 Aug 24 16:07:18.883469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1419/2813] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:18 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:19.316778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:19.318084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:19.321585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:19.322198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:19.324857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.325351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.325847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.326579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.327036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.327464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.327999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.328479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.328911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.329602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.330051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.330503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.534836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:19.537807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:19.543909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-880cb0f8-5b2a-4da4-828f-a10dbe2e36bd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230988 Aug 24 16:07:19.544482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1395/2814] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:19.545901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-89e0a5a8-6a04-4b0e-8293-f58668e0f4dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.229477 Aug 24 16:07:19.546459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1420/2815] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:19.549014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:19.549617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:19.557188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.557680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.558119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.558818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.559274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.559733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.622394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:19.631841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:19.633341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:19.634495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb642aec-3ae9-4075-885f-cf6013a77ba4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089077 Aug 24 16:07:19.635047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1396/2816] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:19.897997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:19.898613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:19.905120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:19.905739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:19.906368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.906867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.907340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.908079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.908550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.908983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.913246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.914136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.914261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:19.914895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:19.915352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:19.915817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.109253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.109961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.116196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d19dda0a-b090-4058-a4dc-d191eba6a805 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222172 Aug 24 16:07:20.116838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1421/2817] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:20.118597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e20cc6d8-cfe9-4451-b69c-1e538d41a6e4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.217184 Aug 24 16:07:20.119174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1397/2818] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:19 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:20.566135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:20.566729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:20.568877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:20.569491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:20.573491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:20.573977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:20.574414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.575093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:20.575543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:20.575695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:20.575991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.576103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:20.576483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.577183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:20.577635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:20.578060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.775385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.779476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.784134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a252782a-68a3-424d-93aa-53dff770ae1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221896 Aug 24 16:07:20.787689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1422/2819] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:20.790460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:20.791210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:20.792140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-81601e8a-444b-477e-bd59-188b414f1b89 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.227556 Aug 24 16:07:20.806229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:20.806229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:20.806229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.806229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:20.806775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:20.806775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:20.806775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:20.808015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1398/2820] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:20.866611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.875827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.877333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:20.878472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f1eb2290-193a-4737-993e-75b8f576d2c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092848 Aug 24 16:07:20.879030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1423/2821] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:21.138665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:21.139276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:21.139981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:21.140600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:21.146610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.147207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.147697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.148279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.148419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.148770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.148880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.149214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.149342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.149912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.150386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.150798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.347321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:21.354357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:21.356219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a61d2342-6dff-4dc4-9db4-fadbaab25f2e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221432 Aug 24 16:07:21.356800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1399/2822] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:21.362779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1e61475c-a6e2-4503-9db5-b700d09fbd5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.226450 Aug 24 16:07:21.363358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1424/2823] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:21 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:21.809187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:21.810021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:21.820197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.820621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:21.821151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.821691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:21.821899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.822979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.824163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.824705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.834478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.835155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.835763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:21.836618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:21.837367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:21.838095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.045311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.049352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.055178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2a296e6f-1abe-4287-8797-a044a3d58d14 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.251068 Aug 24 16:07:22.055806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1400/2824] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:22.058240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7ddf488-f152-4fa5-ad64-0cefb49c7372 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.245099 Aug 24 16:07:22.058976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1425/2825] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:22.060669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:22.061282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:22.068186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:22.068965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:22.069370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.070066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:22.070585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:22.070966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.133057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.141723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.143224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.144457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12cb9a9c-df04-4ebf-a456-577b7682af55 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087698 Aug 24 16:07:22.145018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1401/2826] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:22.377337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:22.377891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:22.384799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:22.385285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:22.385443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:22.385770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:22.386200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.386885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:22.387335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:22.387790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.391880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:22.392367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:22.392823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.393502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:22.393958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:22.394386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:22.592022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.595962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:22.601206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9003b48e-b770-40e6-8f16-4bc3b2e92487 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.227743 Aug 24 16:07:22.601794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1426/2827] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:22.604875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-425c6555-77ab-4099-8c0b-0068ab286703 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.224846 Aug 24 16:07:22.605498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1402/2828] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:23.076257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:23.076929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:23.080605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:23.081215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:23.084258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.084757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.085196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.085893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.086349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.086781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.088462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.088621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.088972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.089655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.090102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.090524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.290932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.295135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.299464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc372d20-b7b1-424f-bf52-74fb497cb314 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227056 Aug 24 16:07:23.300068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1427/2829] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:23.303739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e24621ba-32fb-4746-ab95-11f9b325e7e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226832 Aug 24 16:07:23.304461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1403/2830] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:23.304857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:23.305466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:23.311490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.312022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.312465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.313166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.313626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.314053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.375655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.385333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.386841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.388008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7937a23d-3597-42c7-9dfe-f774af2c8ee9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086922 Aug 24 16:07:23.388569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1428/2831] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:23.622837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:23.623452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:23.626440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:23.627050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:23.630714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.631234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.631690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.632425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.632883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.633305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.633780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.634267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.634695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.635381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:23.635858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:23.636277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:23.826445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.830775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:23.835869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3ba4fb01-a5d3-47cd-8046-b38a996a2316 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217331 Aug 24 16:07:23.836736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1404/2832] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:23.841748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-17e1de4b-9a9e-42e0-bdbd-fca8dcb58798 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.218973 Aug 24 16:07:23.843672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1429/2833] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:23 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:24.325518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:24.326510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:24.328181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:24.328834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:24.333444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.334601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.335050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.336097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.336248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.336592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.336964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.337079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.337667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.337782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.338160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.338588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.536303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:24.540034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:24.543462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:24.544744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-898c3f0f-4052-47cf-905e-0d9af5a1ab75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220232 Aug 24 16:07:24.545582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1430/2834] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:24.549742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e50be616-fbbe-4492-b097-1a0e200aba3c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.228097 Aug 24 16:07:24.550977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:24.551153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1405/2835] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:24.551268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:24.557721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.558202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.558629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.559316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.559796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.560219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.622029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:24.631472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:24.632994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:24.634114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-780b58d9-ecfd-4acc-a17c-a21011d94a82 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087627 Aug 24 16:07:24.634662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1431/2836] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:24.858694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:24.859331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:24.863151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:24.863803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:24.866816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.867300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.867767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.868458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.868909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.869330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.870334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.870774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.871213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:24.871940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:24.872422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:24.872848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:25.070440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:25.073648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:25.078930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-041d1423-0ac7-4d29-86a9-fb90c31fa6f5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.224403 Aug 24 16:07:25.079508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1406/2837] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:25.082187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e61a769-cff4-45fb-96e7-a25eea9c9664 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222494 Aug 24 16:07:25.082771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1432/2838] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:25.567045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:25.567711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:25.572110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:25.572856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:25.573858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:25.574346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:25.574779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:25.575469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:25.575946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:25.576361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:25.579013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:25.579508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:25.579966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:25.580693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:25.581150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:25.581824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.003097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.006651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.012475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf49c6e3-f38d-40c2-96ae-125fc6624817 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.444829 Aug 24 16:07:26.013049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1433/2839] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:26.014809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9ac22c01-0251-43cb-bcb3-745afb3b14a9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.451854 Aug 24 16:07:26.015554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1407/2840] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:26.017525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:26.018124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:26.024245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:26.024886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:26.025154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.025833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:26.026281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:26.026701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.088458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.097328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.099037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.099579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:26.100216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e97e5413-8be7-4b5c-a253-e1291188bfc6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086253 Aug 24 16:07:26.100365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:26.100768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1434/2841] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:26.105111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:26.105708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:26.106447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:26.107214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:26.107583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.108547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:26.108787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:26.109217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.111664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:26.112158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:26.112586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.113269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:26.113718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:26.114136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:26.304431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.312605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e2c3345d-9a65-4dce-a15f-31876a7c0254 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216818 Aug 24 16:07:26.313176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1408/2842] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:26.326861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:26.336510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-02c2c442-8a60-435d-ada2-0a37c2bfaed4 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.234642 Aug 24 16:07:26.337070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1435/2843] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:26 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:27.034248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:27.034889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:27.042487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:27.043590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:27.045294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.046084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.046771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.047938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.048696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.049410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.053851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.054639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.055347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.056285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.057007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.057490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.257281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.261252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.265701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ecd21739-0b3a-45e5-8f36-5953e82cb7f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230206 Aug 24 16:07:27.266318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1436/2844] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:27.269693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1bf50cd5-c459-4d31-8b33-9a68b31454e6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.239370 Aug 24 16:07:27.270385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1409/2845] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:27.271685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:27.272455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:27.278306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.278797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.279228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.279943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.280394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.280811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.339121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:27.340537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:27.345279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.348291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.348787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.349253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.349959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.350452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.350838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.354071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.355592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.356772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-158ec113-deab-4bb6-acdc-d9bacc46a2ea tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089545 Aug 24 16:07:27.357356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1437/2846] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:27.361704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:27.362304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:27.368313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.368795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.369239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.369939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:27.370403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:27.370830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:27.549019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.558016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da034f06-5d59-4a05-99e1-96c36e10858d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222782 Aug 24 16:07:27.558592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1410/2847] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:27.574391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:27.583001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-47364b8f-15e3-4af4-8db5-584e75fd46fb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.224704 Aug 24 16:07:27.583560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1438/2848] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:27 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:28.288756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:28.289369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:28.292320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:28.292968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:28.296108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.296603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.297045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.297788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.298202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.298632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.299406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.299916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.300346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.301035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.301486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.301901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.503809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.508236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.512220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:28.515257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3c09af96-b280-4ed5-a666-ad87cc9aef7f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.231576 Aug 24 16:07:28.515888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1411/2849] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:28.517900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7449472e-66c2-49fd-ac47-cf951c619a22 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.229428 Aug 24 16:07:28.518518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1439/2850] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:28.522069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:28.522712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:28.528589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.529076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.529510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.530327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.530776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.531197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.579925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:28.580454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:28.588069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.588568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.589015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.589727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.590190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.590619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.594256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.604190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.605669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.606814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6dbb0e1f-0568-473e-92c1-f0f4f763e60a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090006 Aug 24 16:07:28.607362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1412/2851] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:28.611808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:28.612408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:28.618262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.618752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.619180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.619904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:28.620344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:28.620767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:28.784134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.793031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f610d107-d052-47a9-bb09-12329eed145d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217022 Aug 24 16:07:28.793616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1440/2852] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:28.809687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:28.818544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eef7a736-470f-4057-87e2-56771b3f24f9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.209695 Aug 24 16:07:28.819375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1413/2853] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:28 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:29.538326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:29.538920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:29.540524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:29.541144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:29.545585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.546072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.546503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.547192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.547480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.547664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.547995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.548108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.548448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.549123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.549578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.550001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.751136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:29.754115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:29.760230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a9cd5540-fbda-4261-82c0-74880f9f4a9a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.226407 Aug 24 16:07:29.760916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1441/2854] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:29.762879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dd2e5ff0-100e-4b19-9048-1c2fc1cd03ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226637 Aug 24 16:07:29.763660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1414/2855] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:29.768901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:29.769702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:29.776488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.776982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.777421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.778122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.778582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.779013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.814178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:29.814800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:29.821843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.822437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.823124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.823993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.824640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.825072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.846062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:29.858444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:29.860000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:29.861159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a56c2abf-601f-4444-8dde-ee738ffd2f2d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.099047 Aug 24 16:07:29.861719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1442/2856] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:29.867467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:29.868231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:29.873410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:29.875121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.875610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.876200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:29.877096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:29.877553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:29.877975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:30.010971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:30.019281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c5ec29a2-6056-4ac4-b94c-b1bfd4376fd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.208980 Aug 24 16:07:30.031661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1415/2857] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:30.039212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:30.047366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8e3f0fe7-001d-42eb-9057-7a9695333b74 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.184368 Aug 24 16:07:30.047975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1443/2858] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:29 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:30.784045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:30.784671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:30.785002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:30.785612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:30.792510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:30.792937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:30.793097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:30.793422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:30.793564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:30.793849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:30.794119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:30.794533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:30.794642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:30.794981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:30.795110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:30.795398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:30.989468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:30.996501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:30.997951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-616be959-326c-4ea6-b7d3-f91b2a11f41a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.216960 Aug 24 16:07:30.998532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1444/2859] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:31.003885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:31.004572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:31.005236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e625e2e0-cbf8-459c-8020-2152f4771162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.225138 Aug 24 16:07:31.006710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1416/2860] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:31.012718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:31.013214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:31.013657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:31.014358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:31.014814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:31.015318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:31.041577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:31.042101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:31.048129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:31.048618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:31.049056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:31.049746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:31.050197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:31.050622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:31.078450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:31.088946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:31.090459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:31.091611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3bf5b3dd-851a-45d8-af66-81bfd660a754 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091378 Aug 24 16:07:31.092188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1445/2861] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:30 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:31.097096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:31.097804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:31.104342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:31.104920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:31.105358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:31.106054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:31.106507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:31.106933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:31.247650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:31.256775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-46a9ea90-4d9e-4aec-86da-fa2d64def9a7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218966 Aug 24 16:07:31.258002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1417/2862] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:31.275867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:31.284075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-582d2731-0d7d-423e-82d0-dd1e271af2ea tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.190916 Aug 24 16:07:31.284642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1446/2863] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:31 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:32.019613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:32.022318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:32.027135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.027309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:32.027767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.027934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:32.028048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.028740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.029192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.029615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.034009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.034485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.034917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.035602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.036079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.036496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.225785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.233940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1e674fa9-b608-417d-8048-e62cba37795f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218164 Aug 24 16:07:32.237757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1418/2864] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:32.238096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.239092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:32.239774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:32.244677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:32.246274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.246593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1ddde537-c080-47b9-8d12-a54083bbeeb3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222809 Aug 24 16:07:32.246754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.247234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.247728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1447/2865] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:32.247954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.248403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.248819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.277873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:32.278491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:32.284590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.285085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.285525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.286275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.287252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.287718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.312532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.321703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.323382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.324737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4847464a-d039-4049-b4e6-c11d480758e7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089178 Aug 24 16:07:32.325578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1419/2866] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:32.330766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:32.331379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:32.339461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.340120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.340662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.341498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:32.341956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:32.342387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:32.487168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.495775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd252f55-8848-4406-b722-3c954beadc56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221553 Aug 24 16:07:32.496443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1448/2867] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:32.514861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:32.524480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0a491ee9-683a-43ed-a352-ddd65e9d60f2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.197947 Aug 24 16:07:32.525058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1420/2868] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:32 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:33.256261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:33.256867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:33.263360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.263881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.264320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.265012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.265466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.265892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.268314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:33.268931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:33.274989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.275472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.275940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.276670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.277122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.277546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.462729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.469549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.471176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-50c1238f-0dab-4be6-9cf6-518dc687a0d7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218774 Aug 24 16:07:33.471780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1449/2869] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:33.477342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:33.477945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:33.479009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a542d727-c20e-41af-9a5f-7814ed1b8377 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215142 Aug 24 16:07:33.479689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1421/2870] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:33.483787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.484274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.484706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.485399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.485850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.486269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.520179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:33.520730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:33.527204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.527727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.528163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.528862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.529345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.529850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.549404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:33.562140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.571146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.572671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.573828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98367226-f688-4317-9471-444e2be7b124 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101129 Aug 24 16:07:33.574387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1450/2871] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:33.578874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:33.579482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:33.586323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.586812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.587246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.587966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:33.588434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:33.589034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:33.704557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.713201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f3d7ea55-2392-4eb1-b750-c3f2020b1460 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.196954 Aug 24 16:07:33.713883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1422/2872] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:33.750505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:33.760104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-793e5892-76df-4aaa-ba08-1062fca2edd5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.184719 Aug 24 16:07:33.760668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1451/2873] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:33 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:34.493790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:34.494359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:34.500904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.501170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:34.501588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.501808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:34.501956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.502502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.502962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.504053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.508221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.508708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.509137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.509828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.510275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.510698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.709687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:34.713212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:34.718115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b658355-146f-4893-9e28-4bc065ea261c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.228729 Aug 24 16:07:34.718970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1423/2874] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:34.722231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e97c2d8-d823-4960-be17-d09776f07343 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224736 Aug 24 16:07:34.722946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1452/2875] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:34.723409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:34.724094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:34.730331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.730850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.731151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.731859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.732306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.732728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.736802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:34.737542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:34.743975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.744388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.744826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.745535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.746013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.746442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.809589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:34.818929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:34.820484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:34.826023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6b4f80b7-ce3c-48b4-8103-add87eeb1a66 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101888 Aug 24 16:07:34.826023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1424/2876] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:34.826607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:34.827217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:34.833507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.835358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.835851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.836588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:34.837049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:34.837482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:34.950477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:34.959408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2915cab9-a585-4292-9d80-d96bb5f80a3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226599 Aug 24 16:07:34.960109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1453/2877] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:34.995366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:35.003393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-431b4813-549f-4ffa-9c94-7ee716a28618 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.180277 Aug 24 16:07:35.003990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1425/2878] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:34 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:35.739949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:35.741326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:35.745778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:35.746899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:35.747833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.748320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.748753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.749448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.749895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.750323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.754401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.754880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.755371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.756210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.756556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.756981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.952419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:35.960621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:35.962596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-72a052f2-6a18-4443-b472-897f51f01783 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226681 Aug 24 16:07:35.963214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1454/2879] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:35.967919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:35.968532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:35.969078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c90cca75-16db-4b59-83f5-e53a12c575ce tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228973 Aug 24 16:07:35.969787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1426/2880] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:35.976249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.976756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.977201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.977911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.978371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.978833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.987742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:35.988361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:35.995092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.995586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.996054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:35.996757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:35.997213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:35.997641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:36.046245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:36.055280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:36.056814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:36.057965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e5ec901c-982d-48be-b395-4042096589a9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093613 Aug 24 16:07:36.058527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1455/2881] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:36.069391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:36.069391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:36.069972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:36.070464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:36.070905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:36.071607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:36.072098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:36.072526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:36.093634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:36.186623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:36.196485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b1ad8716-004f-4174-a1e3-445ab6d8eb5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.212402 Aug 24 16:07:36.197143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1427/2882] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:36.237379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:36.245601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b420d2b3-be03-495c-89f5-9f7e1be27034 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.186043 Aug 24 16:07:36.246167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1456/2883] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:36 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:36.984313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:36.984916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:36.991417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:36.992166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:36.992436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:36.992922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:36.993571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:36.994277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:36.994729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:36.995155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:36.998901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:36.999391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:36.999869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.000567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.001035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.001462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.190605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.193662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.200505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-baa316ef-f4fc-4e31-9f96-9dce212cf59b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.219575 Aug 24 16:07:37.201467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1428/2884] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:37.202296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1c036829-4d6a-4768-b16e-d825abb9b643 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215947 Aug 24 16:07:37.202868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1457/2885] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:37.207305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:37.208658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:37.220024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:37.220599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.220736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:37.221105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.221686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.222401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.222857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.223284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.227384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.227929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.228370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.229072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.229535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.229959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.307970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.316490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.317995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.319999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f3d7b63-9061-4409-8238-5daa78ca1553 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.117550 Aug 24 16:07:37.320573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1429/2886] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:37.324954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:37.325555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:37.331898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.332379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.332907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.334402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:37.335012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:37.335131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:37.388343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.397391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-52f40e5b-d5c7-44be-bdca-fad44c96e73e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.180980 Aug 24 16:07:37.397978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1458/2887] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:37.476060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:37.484152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9f28dc63-5b56-47c1-894e-6757fbfa04a8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.162637 Aug 24 16:07:37.484705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1430/2888] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:37 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:38.224514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:38.225124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:38.225693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:38.226312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:38.232530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.233015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.233458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.233699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.234151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.234300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.234590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.234710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.235009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.235283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.235760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.236186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.432980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.436354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.441789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-95933eda-ddbf-4503-b521-26d3bdbde86b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.221125 Aug 24 16:07:38.442380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1459/2889] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:38.445366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bf3c7afc-cf59-490d-80a7-3e8a6b8d6bf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223306 Aug 24 16:07:38.455846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1431/2890] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:38.456064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:38.456064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:38.456291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:38.456291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:38.456789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.456789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.456789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.456789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.457178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.457178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.458153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.458942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.459647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.460502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.461056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.461562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.526891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.535898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.537997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.539216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ef6d033f-96da-43f5-ac1b-73e63fed5463 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095411 Aug 24 16:07:38.539806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1460/2891] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:38.544209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:38.544829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:38.550679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.551175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.551618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.552911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:38.553691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:38.554218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:38.645595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.654038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-727de620-a0ac-46f4-bd14-a216a089c513 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.207035 Aug 24 16:07:38.654614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1432/2892] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:38.705746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:38.714499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bd999ff5-0c2c-4981-91bb-6098c4bc4d85 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.173739 Aug 24 16:07:38.715241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1461/2893] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:38 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:39.465618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:39.466237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:39.468969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:39.469580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:39.472800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.473287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.473723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.474431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.474877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.475299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.476158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.476635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.477066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.477755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.478337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.478759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.671817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.674824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.680952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-83621283-8025-4f0a-a890-9d9a7abb7742 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.219081 Aug 24 16:07:39.681643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1433/2894] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:39.684090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c1404cce-863c-40e2-a4e3-bac1620efb16 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218718 Aug 24 16:07:39.685377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1462/2895] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:39.686773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:39.687372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:39.693380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.693860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.694293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.695058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.695512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.695968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.702694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:39.703443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:39.711502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.711972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.712425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.714127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.714617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.715018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.776345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.785187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.787337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.788541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71b434fd-1d4f-4a85-b0ec-889510c31d4e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.105938 Aug 24 16:07:39.789103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1434/2896] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:39.793481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:39.794090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:39.800229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.800728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.801167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.801947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:39.802367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:39.803263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:39.908864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.917354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e40d8d0e-21c2-4a8b-aa8d-e570aa703338 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230758 Aug 24 16:07:39.918047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1463/2897] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:39.960758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:39.969619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a27f190b-345a-4ece-80de-d26bf9b18548 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.179433 Aug 24 16:07:39.970108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1435/2898] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:39 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:40.703222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:40.703862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:40.706070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:40.706940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:40.710818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.711301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.711785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.712484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.712931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.713348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.713645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.714188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.714627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.715346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.715826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.716256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.913516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:40.916132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:40.922510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5674cc3a-7ad5-452a-8916-2d76acb51bcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223061 Aug 24 16:07:40.929697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1464/2899] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:40.929697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:40.930190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:40.933124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fb7abbef-fb8d-480e-8bd5-53768cafb47c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230598 Aug 24 16:07:40.939944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1436/2900] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:40.940121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.940121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.940121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.940121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.940558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.940558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.940827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:40.941457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:40.947886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.948381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.948824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:40.949526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:40.949981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:40.950407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:41.025975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:41.034627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:41.036136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:41.037964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e052e9a-65bf-447d-9596-b97096af47cd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.112557 Aug 24 16:07:41.038583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1465/2901] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:41.042942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:41.043538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:41.049308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:41.049795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:41.050434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:41.051127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:41.051581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:41.052551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:41.157367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:41.168433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7c896c48-2fe7-44f4-8c32-bf8f08ba53ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.233324 Aug 24 16:07:41.169030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1437/2902] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:41.205642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:41.214634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fe627b4b-0ab0-4cc1-9a80-ceee95cae751 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.175091 Aug 24 16:07:41.215204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1466/2903] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:41 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:41.948966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:41.949589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:41.954730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:41.955441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:41.956192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:41.956936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:41.957374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:41.958068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:41.958594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:41.959049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:41.962795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:41.963288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:41.963759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:41.964468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:41.964928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:41.965358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.154539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.157514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.163945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2eb77cdd-658d-4aac-a893-7b47add48470 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.219001 Aug 24 16:07:42.164640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1438/2904] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:42.166500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ede3bfda-1274-4fa0-8d0a-d55cdf20c998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215544 Aug 24 16:07:42.167278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1467/2905] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:42.169423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:42.170111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:42.176297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:42.176623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:42.177121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.178551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:42.179148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:42.179595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.183834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:42.189810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:42.190424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:42.196610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:42.197104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:42.197592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.198286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:42.198737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:42.199161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.246927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.256425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.257908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.259052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b7877bc6-9c42-406d-a6ec-1ec907aa32b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093435 Aug 24 16:07:42.259608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1439/2906] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:42.263998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:42.264592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:42.271091 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:42.272190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:42.273512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.274810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:42.274810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:42.275119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:42.385367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.394203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8508e7bc-9737-4eb2-8a9c-8e3f4fa6e594 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.208137 Aug 24 16:07:42.394788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1468/2907] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:42.429387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:42.437535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9b5547fd-f55c-4c63-8663-1364dd5f38dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.176932 Aug 24 16:07:42.438145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1440/2908] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:42 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:43.190027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:43.190976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:43.191995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:43.193544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:43.202846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.203708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.203833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.204523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.204790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.205247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.206272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.206639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.207328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.207473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.208068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.208180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.400674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.408790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a41b3461-a1c8-4053-90d3-522c9ac5d153 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224988 Aug 24 16:07:43.410788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1469/2909] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:43.412969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.414346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:43.415002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:43.420872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.421358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.421490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dcbd89de-9d09-4872-82c8-456cc8102989 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.235861 Aug 24 16:07:43.421798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.423715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1441/2910] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:43.423901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.423901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.423901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.426785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:43.428629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:43.434529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.435025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.435463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.436201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.436649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.437098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.491943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.500800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.502280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.503424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d9cdac5-b858-41c1-93ec-6872398fc811 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093153 Aug 24 16:07:43.504012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1470/2911] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:43.514264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:43.514878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:43.521172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.521658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.522147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.522845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:43.523294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:43.523739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:43.629728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.638724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-23d921dd-a8ec-45cd-808b-3008595d7b6d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215350 Aug 24 16:07:43.639418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1442/2912] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:43.673808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:43.681854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f7adf7a3-66e7-4be5-8713-94cc2db55328 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.176898 Aug 24 16:07:43.682417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1471/2913] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:43 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:44.430033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:44.430636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:44.437312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.437614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.438050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.438738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.439188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.439614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.442419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:44.443549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:44.449935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.450422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.450850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.451539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.452015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.452433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.648240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.656758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a6f7c78f-d68e-41c9-a9e6-ef862cb95f2f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.230794 Aug 24 16:07:44.657694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1443/2914] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:44.661990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:44.662580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:44.664303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.668690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.669162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.669592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.670285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.670727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.671145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.672507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a43e40ae-6e37-47a7-9bc2-757cc19ec92c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.234100 Aug 24 16:07:44.673080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1472/2915] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:44.678082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:44.678703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:44.684574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.685001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.685443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.686145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.686606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.687033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.691014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:44.741905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.751004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.752583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.753765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-837b5162-4767-4ea8-aff5-71c89d4ce202 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095480 Aug 24 16:07:44.754417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1444/2916] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:44.759578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:44.760193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:44.766638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.767201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.767731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.768487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:44.769004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:44.769487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:44.877092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.886194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-13e8cdd9-97c2-4857-8a7c-b4c098c002d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.212099 Aug 24 16:07:44.886891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1473/2917] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:44.922559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:44.931433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-53c119ad-67f9-45d8-9d6b-d2846b568055 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.176163 Aug 24 16:07:44.932042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1445/2918] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:44 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:45.679340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:45.680006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:45.686430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.686915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.687385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.688106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.688569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.688997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.693736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:45.694411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:45.700821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.701303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.701731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.702421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.702872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.703296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.892302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:45.897354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:45.901243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b1b2e229-22be-4670-8ef7-898da46852fb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226607 Aug 24 16:07:45.903329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1474/2919] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:45.912664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0dbf57da-c536-4912-8d90-1a6dbc7bcd7b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215822 Aug 24 16:07:45.912664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1446/2920] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:45.913026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:45.913026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:45.913210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:45.913210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:45.914966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.915685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.916298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.917144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.917745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.918315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.918610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.919112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.919556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:45.920282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:45.920761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:45.921185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:46.006380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:46.015476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:46.017117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:46.018348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-39bf38a5-0c49-4e0a-92a0-a4dd47569d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.114053 Aug 24 16:07:46.019072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1475/2921] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:46.024252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:46.024834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:46.031077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:46.031562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:46.032043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:46.032730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:46.033188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:46.033620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:46.088066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:46.096431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-97712f61-038e-40f8-8d11-bae323e9cd83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.189201 Aug 24 16:07:46.097014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1447/2922] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:46.171075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:46.181539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d0c70f4b-8a58-487b-810e-3f1dfd1abd66 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.161572 Aug 24 16:07:46.182108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1476/2923] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:46 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:46.926322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:46.927495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:46.927934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:46.928044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:46.933958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:46.934454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:46.934715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:46.934889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:46.935197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:46.935621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:46.935776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:46.936100 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:46.936332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:46.936526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:46.936780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:46.937201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.133624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.137380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.142190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f2c40e40-f92f-485d-bae3-87240772585b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219235 Aug 24 16:07:47.142808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1477/2924] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:47.147897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:47.148507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:47.154620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d86a1ab3-8983-4f35-8ef7-cf6b510f2df2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.231996 Aug 24 16:07:47.154813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:47.155117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:47.157369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.157528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1448/2925] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:47.157635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:47.157635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:47.157635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.160480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:47.163617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:47.167991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:47.168482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:47.168916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.169615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:47.170061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:47.170620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.234872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.244363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.245849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.247001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b59c8a6-56d6-444b-aee1-2db70ae42dbe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.103263 Aug 24 16:07:47.247538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1478/2926] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:47.251912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:47.252509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:47.258213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:47.258692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:47.259771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.259900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:47.260266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:47.260688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:47.351231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.359790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-53c87787-fe82-4f4e-8243-6b5a464dd1cf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.203063 Aug 24 16:07:47.360687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1449/2927] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:47.409467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:47.418254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4651c14-ebfc-428c-b668-e8a5e783a005 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.169748 Aug 24 16:07:47.418817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1479/2928] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:47 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:48.166048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:48.166726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:48.173804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.174306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.174750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.175459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.175970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.176358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:48.176823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.178543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:48.185721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.190402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.190941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.191710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.192188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.193251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.384716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.393378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.395130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4f37215a-7795-4607-a3d7-f5ecee63d28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.234023 Aug 24 16:07:48.395998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1450/2929] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:48.400588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:48.401251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:48.402544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4c92e8b-73a6-48a2-bf7d-d31349aef094 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.230005 Aug 24 16:07:48.403296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1480/2930] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:48.407301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.407464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:48.407900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.408104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:48.408457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.409210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.409730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.410233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.414262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.420577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.420577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.420577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.420577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.421027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.508940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.517524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.519000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.520163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-75a6dee0-83d8-4820-bc8f-c836664f2195 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.123179 Aug 24 16:07:48.520819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1451/2931] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:48.527997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:48.528924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:48.538255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.539107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.539891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.541101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:48.541901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:48.542652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:48.582772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.592626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9a1c5349-1133-43d1-bfdf-2d94f868593a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.188454 Aug 24 16:07:48.593697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1481/2932] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:48.686299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:48.694558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb8e47f9-cb6b-489d-b82b-dd9e5c6b57e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.172436 Aug 24 16:07:48.695145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1452/2933] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:48 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:49.424353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:49.424972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:49.428628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:49.429242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:49.431769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.432264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.432703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.433451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.433909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.434332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.435606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.436187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.436629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.437304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.437765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.438200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.857222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:49.863917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:49.865891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7221d945-e2b6-4b3b-8af3-7c118d33a417 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.445333 Aug 24 16:07:49.866466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1482/2934] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:49.870923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:49.871480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:49.873349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5c57ae59-67f0-4dc7-8319-fb28afa4a9df tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.448791 Aug 24 16:07:49.874237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1453/2935] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:49.878542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:49.879211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:49.885551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.886298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.886522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.886727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.887008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.887669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.887811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.888240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.888713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.889608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:49.890087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:49.890528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:49.978986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:49.987489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:49.989022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:49.990674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d2ce4695-082c-4134-91b1-3d115119b526 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.123280 Aug 24 16:07:49.991368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1483/2936] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:49 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:49.995894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:49.996499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:50.002390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:50.002880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:50.003368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:50.004112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:50.004572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:50.005647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:50.059113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:50.068283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5d4f9b48-f4ff-4072-bf09-f3267c694a01 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.192590 Aug 24 16:07:50.068995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1454/2937] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:50.141630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:50.150490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b09c316d-024a-4a75-9ca5-662be7796d19 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158120 Aug 24 16:07:50.151047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1484/2938] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:49 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:50.886885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:50.887567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:50.894242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:50.894729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:50.894846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:50.895262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:50.895494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:50.899711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:50.900211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:50.900660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:50.902413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:50.902896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:50.903332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:50.904057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:50.906000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:50.906000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.100404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.103800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:51.105474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.109838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a2652e5b-e0ad-40c6-8871-134a27c1e435 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226789 Aug 24 16:07:51.110414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1455/2939] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:51.113744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9bb4a0ca-a105-4bf0-862a-f780b01e62f1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222800 Aug 24 16:07:51.127671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1485/2940] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:51.127897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:51.127897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:51.128130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:51.128130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:51.128340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:51.128340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:51.128340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.128340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:51.128711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:51.128711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.128883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:51.128883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:51.128883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.128883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:51.129227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:51.129545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.195309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.204349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.205866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.207285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b4f7b122-d12c-4f5b-b59a-68aabe262fc0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095966 Aug 24 16:07:51.207875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1456/2941] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:51.212364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:51.213014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:51.219216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:51.219793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:51.220295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.221049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:51.221569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:51.222098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:51.315815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.324694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-051b4517-e7df-49b2-aca5-3af6ec9b88bf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.208236 Aug 24 16:07:51.325223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1486/2942] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:51.383779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:51.391984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-61aaaec3-64e7-4b17-8424-90f414ca83e9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.183094 Aug 24 16:07:51.392554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1457/2943] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:51 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:52.132263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:52.133047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:52.134796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:52.135408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:52.139526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.140047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.140485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.141180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.141631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.141756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.142054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.142221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.142659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.143342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.143818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.144380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.341888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.346173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.351253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1374c377-6b28-42d1-a549-6b6ec5a1b80d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223176 Aug 24 16:07:52.351862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1487/2944] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:52.355078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-51795c07-8633-4380-b031-59f43f9ee02d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224039 Aug 24 16:07:52.356593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:52.357371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:52.363091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.363809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.364271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.365722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.366187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.366619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.367978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1458/2945] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:52.373342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:52.373963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:52.380414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.380906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.381341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.382037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.382549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.382922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.432134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.441085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.443260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.444559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-129ebdf8-ad53-4569-b6f4-7f8a53b67839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091605 Aug 24 16:07:52.445209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1488/2946] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:52.449603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:52.450239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:52.456594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.457149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.457640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.459375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:52.459737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:52.460226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:52.576462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.586420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78e2fde2-4326-4df1-bb67-51ba77648f1f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216955 Aug 24 16:07:52.599476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1459/2947] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:52.627334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:52.631390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:52.637236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e95dfd7-6c37-4f2e-a657-ed48d12e768a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.191087 Aug 24 16:07:52.637746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1489/2948] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:52 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:53.374120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:53.374744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:53.380566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:53.381305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:53.382642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.383176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.383617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.384358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.384821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.385259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.388034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.388524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.388965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.389667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.390127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.390553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.586274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.591101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.594745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-290dbff8-f9a4-4856-bdbd-ba37860e0ac2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224571 Aug 24 16:07:53.595325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1460/2949] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:53.600527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7ec4866-61ca-4ef5-bf38-4054b47da5cf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224444 Aug 24 16:07:53.600727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:53.601504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1490/2950] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:53.601958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:53.607919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.608394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.608822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.609506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.609962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.610374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.618891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:53.619503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:53.625507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.625928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.626364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.627057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.627512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.627964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.675699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.685237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.686742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.687947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6bf92e36-3de6-4eba-b19b-0502ede7f71d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091639 Aug 24 16:07:53.688494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1461/2951] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:53.693888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:53.694378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:53.700447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.700940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.701380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.702085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:53.702548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:53.702982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:53.813871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.823016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1a875997-185a-426a-a881-c5f15ecb9202 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.207733 Aug 24 16:07:53.823816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1491/2952] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:53.860977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:53.869512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7a4866fe-5fa2-4fff-b74e-1e1932d5a2f8 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.180072 Aug 24 16:07:53.870086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1462/2953] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:53 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:54.617600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:54.618148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:54.621718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:54.622336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:54.624759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.625255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.625693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.626387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.626842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.627267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.628595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.629084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.629675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.630235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.630688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.631112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.822134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:54.827453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:54.830754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d8a149ca-72e8-4dc8-8cd9-2215feb702b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.217986 Aug 24 16:07:54.831644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1492/2954] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:54.836736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bbea641f-c3a7-475b-9bad-524c9bb45dcc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218589 Aug 24 16:07:54.836924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:54.837227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:54.838312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1463/2955] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:54.842721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:54.844759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.845253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.845692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.846530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.846917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.847041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:54.847344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.848344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:54.855946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.856440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.856912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.858136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.858136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.858511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.939006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:54.948276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:54.949825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:54.950964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aed2eb6d-790e-492e-9ed8-25bfe116d2d5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.118400 Aug 24 16:07:54.951510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1493/2956] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:54.955893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:54.956743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:54.963288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.963811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.964242 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:54.964915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:54.965371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:54.965790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:55.027002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:55.035511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60855b5f-08f5-4bff-a9bb-c2259e16bd93 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.193861 Aug 24 16:07:55.043774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1464/2957] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:55.112986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:55.121290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-757c589b-b8a8-43e2-9e3d-d6f18380828e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.168818 Aug 24 16:07:55.121857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1494/2958] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:54 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:55.852835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:55.853536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:55.858328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:55.859047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:55.860475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:55.860968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:55.861403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:55.862098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:55.862555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:55.862978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:55.866548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:55.867066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:55.867505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:55.868297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:55.868700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:55.869336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.060590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.063339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.069264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-13e432bc-ffd5-4647-854b-426b29434626 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.220398 Aug 24 16:07:56.069841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1465/2959] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:56.072236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63c7ee63-bef4-4dcb-80c7-24da1039a94c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217667 Aug 24 16:07:56.076674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1495/2960] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:56.076823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:56.076823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:56.077479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:56.078089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:56.082157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:56.082940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:56.084149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.084407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:56.084857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:56.084958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:56.085318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:56.085420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.085749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.086012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:56.086473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:56.086902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.176153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.186300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.187821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.188969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c7ecf33a-b447-4541-8fc1-204b68505d38 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.118218 Aug 24 16:07:56.189529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1466/2961] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:56.194811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:56.195262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:56.201331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:56.201820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:56.202263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.202965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:56.203492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:56.203959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:56.254952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.263306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9351aeda-5400-4a61-9c97-02617284140c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.189231 Aug 24 16:07:56.263912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1496/2962] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:56.340239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:56.349107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-63cc2515-13d9-4ab9-9499-bf61c940d0fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158041 Aug 24 16:07:56.349722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1467/2963] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:56 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:57.090926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:57.091515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:57.093952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:57.094575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:57.098140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.098563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.098999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.099726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.100184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.100608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.101886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.102383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.102821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.103736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.104200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.104633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.301074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.305042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.310064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dde82235-23f9-4552-9c3f-153580afd25c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219884 Aug 24 16:07:57.310640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1468/2964] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:57.313336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7688e81-c1b4-44e2-b383-66a8794c037d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226382 Aug 24 16:07:57.322104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1497/2965] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:57.322341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:57.322341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:57.322523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:57.322523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:57.322714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:57.323730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.324219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.324852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.325342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.326023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.326447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.328262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.328853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.329260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.329968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.330429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.330871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.399951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.408823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.410305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.411492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d3704fa8-2d44-4da5-8db8-0f1811754149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.099941 Aug 24 16:07:57.423836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1469/2966] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:57.423836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:57.423836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:57.423836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.424311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.424311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.424580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:57.425030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:57.425506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:57.524009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.532336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f047d1f1-f262-4596-a5bd-da6b3d4660ff tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217470 Aug 24 16:07:57.532913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1498/2967] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:57.578773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:57.587350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-79902ed7-6c1c-4737-b1d0-79482bfa1660 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.174273 Aug 24 16:07:57.587953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1470/2968] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:58.330964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:58.331931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:58.336732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:58.337358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:58.339090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.339580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.340049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.340751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.341199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.341622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.343609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.344122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.344562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.345388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.345690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.346115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.531456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.539275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.540029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c053a50c-2c37-41b8-b64d-0e418bd6f22e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.212947 Aug 24 16:07:58.540609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1499/2969] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:58.547508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ae9140a-48d2-4512-943a-e4d14087c0dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.215192 Aug 24 16:07:58.549562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1471/2970] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:58.551958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:58.552980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:58.554872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:58.555595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:58.559394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.559914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.560353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.561052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.561510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.561768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.561928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.562393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.562830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.563528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.564007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.564431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.584011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:07:58.652696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.661447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.662962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.664178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6c081023-2ac9-40bb-a93d-ffa6e2bbcda5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.122623 Aug 24 16:07:58.664739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1500/2971] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:58.669179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:58.669895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:58.675861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.676985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.678095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.678810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:58.679302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:58.679772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:58.734621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.743450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b6934866-dbd4-4769-b4e1-e8c48b0aec7a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.192503 Aug 24 16:07:58.744057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1472/2972] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:58.818487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:58.826792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d107d95-64ca-45c8-9c09-8f155fcc2062 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.161062 Aug 24 16:07:58.827364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1501/2973] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:58 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:59.561968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:59.562626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:59.569725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:59.570268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.570587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.570845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:59.571014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.571729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.572178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.572595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.577494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.577981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.578419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.579121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.579582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.580033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.782538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:59.790762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:59.791457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e96cbc15-0a19-4cb7-b07d-36af880bdc6c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.233305 Aug 24 16:07:59.792066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1473/2974] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:07:59.796655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:59.797252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:59.800361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c27765dc-1765-47d4-a86a-238c6102a244 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.235099 Aug 24 16:07:59.802372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1502/2975] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:07:59.806285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:59.806898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:59.808853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.809007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.809494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.810267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.810786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.811273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.813638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.814193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.814510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.815222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.815704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.816138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.885703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:59.894870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:59.896705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:07:59.897862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-661c04d4-35b8-46bc-8091-43956e775c30 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.104884 Aug 24 16:07:59.898461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1474/2976] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:07:59 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:07:59.908432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:07:59.909230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:07:59.917041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.917532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.917969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:07:59.920184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:07:59.920184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:07:59.920184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:00.009650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:00.017888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eb2ada1e-5368-4028-978e-82d94195ef39 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215265 Aug 24 16:08:00.018693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1503/2977] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:00.070003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:00.078384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2b2ead3f-7e0b-4256-b577-c54db2103c2d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.174160 Aug 24 16:08:00.078977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1475/2978] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:07:59 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:00.813851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:00.814478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:00.821352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:00.822095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:00.822341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:00.822988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:00.823446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:00.823754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:00.824216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:00.824397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:00.832067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:00.832561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:00.833575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:00.834321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:00.834728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:00.835242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.029194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.037882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ce4a24ca-c255-4379-a14a-dbb3a2046d8c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227863 Aug 24 16:08:01.038467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1504/2979] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:01.042584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.043112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:01.043747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:01.049698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:01.050185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:01.050621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.050963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c7bb88c2-a5fb-4065-a641-3c61dd87b6b7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.231082 Aug 24 16:08:01.051834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:01.052298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:01.052874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.052996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1476/2980] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:01.057284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:01.057892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:01.063815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:01.064367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:01.064761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.065463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:01.065921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:01.066347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.119960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.128971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.131202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.132389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-00da6f8f-9dce-491d-bc88-c956c5a15be8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092999 Aug 24 16:08:01.132950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1505/2981] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:01.137402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:01.138006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:01.144262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:01.144757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:01.145783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.146566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:01.147027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:01.148078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:01.166698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:01.259662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.268544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-11bcc5be-07ae-4003-9a78-30a0cc9a3465 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.214662 Aug 24 16:08:01.269143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1477/2982] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:01.309646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:01.319597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-546aefc7-ff3c-4ae7-a803-e283e49041f7 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.185504 Aug 24 16:08:01.320143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1506/2983] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:01 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:02.058543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:02.059169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:02.065569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.066042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.066469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.067270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.067746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.068176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.073219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:02.073955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:02.080459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.080853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.081549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.082245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.082706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.083134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.268010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.275378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.278928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-47df60cc-36b0-49dc-b117-b50bdfdeda01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224160 Aug 24 16:08:02.279609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1478/2984] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:02.285252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f98835fd-8f25-456e-99d1-07a5f246413d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.214775 Aug 24 16:08:02.285449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:02.285449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:02.292543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.293204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.293804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.293951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1507/2985] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:02.294427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.294892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.295326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.298363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:02.298974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:02.305735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.306298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.306801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.307562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.308108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.308647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.367517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.376300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.377799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.378953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0896c8d4-915f-4f00-b767-e900cdadb049 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098408 Aug 24 16:08:02.379546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1479/2986] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:02.384773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:02.385384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:02.391548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.392090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.392538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.393349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:02.393794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:02.394216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:02.499752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.509069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4b9581cc-0a09-48a3-a4f2-6a8863fbef5a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.214314 Aug 24 16:08:02.509739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1508/2987] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:02.544476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:02.553205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7497dfc5-666d-437f-a05b-903479692cfa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.171906 Aug 24 16:08:02.553776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1480/2988] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:03.302287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:03.302916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:03.305536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:03.306154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:03.309878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.310367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.310802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.311499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.311986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.312411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.312691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.313177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.313617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.314570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.315030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.315455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.532050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.535272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.541061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-edebf283-da32-4ff4-bd5b-d252af3872ff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.243296 Aug 24 16:08:03.541647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1509/2989] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:03.546173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:03.546775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:03.553671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-283ede79-cfc5-483e-b8c8-146ee72e2976 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.251821 Aug 24 16:08:03.553850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.554227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.560453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.560641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1481/2990] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:03.560749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.560749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.560749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.561017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:03.561017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:03.566292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.566824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.568048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.568784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.569410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.569670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.626140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.638066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.639595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.640973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-80b3eda7-cac9-40e9-a971-6157d0ba3edd tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098403 Aug 24 16:08:03.641576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1510/2991] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:03.649309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:03.649309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:03.654725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.655284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.655776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.656687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:03.657052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:03.657639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:03.790572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.799072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9f35dce-5d5a-43c2-874e-5f9a5f0e67e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.243269 Aug 24 16:08:03.799665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1482/2992] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:03.822529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:03.831027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-22d43482-301d-4a9e-a4a8-85eab4bee57e tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.188448 Aug 24 16:08:03.831938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1511/2993] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:03 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:04.562347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:04.562910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:04.570421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.570885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.571326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.572056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.572512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.573056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.575443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:04.576207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:04.585543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.586064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.586506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.587215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.587700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.588133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.781420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:04.785311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:04.790159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-00021fb5-0684-4a4b-ba01-246eb799345f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.231744 Aug 24 16:08:04.803754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1483/2994] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:04.804932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ff124a08-7b62-406b-9305-62eabb90371a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222809 Aug 24 16:08:04.804932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1512/2995] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:04.805187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:04.805187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:04.805187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.805187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.805713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.805713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.805713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.806136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.821704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:04.822596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:04.828946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.829441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.829881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.830583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.831040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.831794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.874278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:04.883905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:04.885393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:04.886538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-72dd8f30-ae03-465e-a18d-08adefbc01a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.094809 Aug 24 16:08:04.887099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1484/2996] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:04.891542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:04.892179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:04.898285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.898773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.899207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:04.899931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:04.900385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:04.900807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:05.014037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:05.022987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f51c16e3-9444-45f6-95ba-e36a7c636dfd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.206119 Aug 24 16:08:05.023822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1513/2997] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:05.058766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:05.066998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12b3a0d7-401d-484c-bb41-eaf7ba37f15c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.178878 Aug 24 16:08:05.067613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1485/2998] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:05.814769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:05.815336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:05.815749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:05.816207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:05.822708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:05.823202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:05.823653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:05.823808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:05.824160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:05.824412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:05.824711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:05.824832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:05.825243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:05.825465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:05.825992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:05.826485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.024105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.027296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.032286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4d6b26f9-4594-4356-86f3-13166dc4b351 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220723 Aug 24 16:08:06.033128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1486/2999] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:06.036155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b80f888c-1a50-4b5c-aa43-1de450de8a41 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225157 Aug 24 16:08:06.036870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1514/3000] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:06.037513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:06.038112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:06.044096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:06.044580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:06.045008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.045695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:06.046141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:06.046563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.054442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:06.055048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:06.061211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:06.061649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:06.062092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.062925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:06.063385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:06.063882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.111176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.120815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.122297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.123435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-72e9f9ca-9629-4711-96f5-f51e69254685 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089596 Aug 24 16:08:06.124020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1487/3001] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:06.128351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:06.128952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:06.135823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:06.136308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:06.136741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.137431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:06.137879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:06.138296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:06.250769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.260074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d971590b-1ef4-4c3a-b165-07061bf853d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.209446 Aug 24 16:08:06.260760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1515/3002] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:06.293730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:06.302500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6f85dc24-a3a2-4a43-a445-2cd3f2602266 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.177538 Aug 24 16:08:06.303058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1488/3003] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:06 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:07.054427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:07.055037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:07.058246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:07.058855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:07.061545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.062039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.062486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.063187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.063774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.064304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.065692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.066170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.066627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.067978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.068453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.068868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.073062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:07.267679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.271985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.276387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f29336c-de6a-4747-8dc0-6acddf9a3f96 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.226817 Aug 24 16:08:07.276982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1516/3004] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:07.280253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ecae3dd2-5756-4a1b-97c2-b08b0e7295ae tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225720 Aug 24 16:08:07.280938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1489/3005] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:07.281708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:07.282398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:07.285977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:07.286596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:07.294134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.294624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.295058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.295781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.296266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.296520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.296672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.297016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.297454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.298225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.298729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.299068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.386269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.395246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.396768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.397903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bd0826e7-742d-4fe9-a31e-c073eac4e839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.119914 Aug 24 16:08:07.398566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1517/3006] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:07.403627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:07.404270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:07.412937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.413336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.413778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.414490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:07.414955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:07.415405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:07.451485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.460415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-64058a77-29a6-4d14-a627-51c7e5cd9092 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.178608 Aug 24 16:08:07.460995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1490/3007] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:07.547241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:07.556909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5cbc31db-452a-4227-ae9a-d7bd7d3c2d94 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157459 Aug 24 16:08:07.557472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1518/3008] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:07 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:08.302538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:08.303240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:08.303651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:08.303778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:08.309742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.309946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.310241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.310374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.310689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.310827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.311384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.311520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.311897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.312037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.312319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.312440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.512844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:08.515922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:08.521572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-272af2dd-2541-4e46-b70c-242e19c05620 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223083 Aug 24 16:08:08.522248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1519/3009] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:08.524648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-295707aa-628e-406d-9582-4ee8647bdc38 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226169 Aug 24 16:08:08.525340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1491/3010] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:08.529563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:08.530162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:08.530639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:08.531611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:08.536281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.536767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.537220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.537882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.538328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.538747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.538862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.539273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.539747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.540478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.540934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.541362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.858288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:08.868115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:08.869635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:08.870787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0ee39488-553b-4d02-a5c3-4e44c0019c3a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.347615 Aug 24 16:08:08.871342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1520/3011] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:08.875957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:08.876681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:08.883228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.883749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.884186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.884888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:08.885349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:08.885779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:08.921331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:08.930465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-44364f25-6cbd-400c-bdc3-198ed6df2c12 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.404275 Aug 24 16:08:08.931045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1492/3012] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:09.018197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:09.026674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-044c56db-7ea1-48ae-b243-c8aaf3737f7c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.154337 Aug 24 16:08:09.027240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1521/3013] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:08 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:09.544099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:09.544712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:09.546511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:09.547129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:09.551144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.551643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.552132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.552829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.553285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.553688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.553808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.554175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.554612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.555306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.555796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.556228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.759948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:09.765482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:09.768443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cd709619-2a54-4d13-8a6f-14720dc41d67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.229097 Aug 24 16:08:09.769457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1493/3014] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:09.775302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14796235-b828-4510-9db9-c9ec1e94abd0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.232583 Aug 24 16:08:09.776032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1522/3015] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:09.893167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:09.893781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:09.900422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.900907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.901341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.902031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.902486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.902913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.951957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:09.952578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:09.960249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.960746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.961191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.961898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:09.962359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:09.962789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:09.967009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:09.970644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:09.982363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:09.984005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:09.985209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05442327-9dd7-44cc-b184-5dd6983b46d4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095949 Aug 24 16:08:09.986159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1494/3016] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:09 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:10.048274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:10.048935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:10.056021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:10.056524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:10.056984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:10.057680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:10.058136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:10.058565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:10.235310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:10.244087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5b7eee54-a0ac-4d00-8ba7-0eee14c6fc6a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.200595 Aug 24 16:08:10.244737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1495/3017] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:10 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:10.280577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:10.289023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-03dd97b9-704a-4c45-953e-9ae9e9c1451c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.340862 Aug 24 16:08:10.289585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1523/3018] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:10.790591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:10.791185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:10.797276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:10.797889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:10.798161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:10.798650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:10.799088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:10.799816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:10.800270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:10.800694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:10.804464 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:10.804945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:10.805372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:10.806061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:10.806510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:10.806927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:10.997413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.000225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.006649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-abf11338-86da-4ecc-a4d3-a6ab2e2d9783 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219821 Aug 24 16:08:11.007232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1496/3019] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:11.009355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-939182e0-1425-4f02-8377-ff1599e9d666 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.215858 Aug 24 16:08:11.011488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1524/3020] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:11.011614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:11.012256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:11.018121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:11.018605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:11.019045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:11.020431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:11.020890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:11.021318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:11.085342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.094092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.095601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.097000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb05f9cd-c3df-4b76-9e3f-d51ad43a74cf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088603 Aug 24 16:08:11.097335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1497/3021] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:11.265771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:11.266412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:11.273391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:11.273904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:11.274340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:11.275030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:11.275496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:11.275941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:11.310092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:11.310704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:11.318870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:11.319443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:11.319945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:11.320661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:11.321119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:11.321580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:11.454602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.463566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7ceca53-5283-446d-b2e6-9042e2933a69 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.201643 Aug 24 16:08:11.464158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1525/3022] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:11 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:11.485884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:11.495245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-45b083f5-5011-4f04-9630-f5def8e5610e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.188905 Aug 24 16:08:11.495834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1498/3023] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:12.029020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:12.029643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:12.030315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:12.030937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:12.037192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.037694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.038067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.038355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.038616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.038877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.039049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.039275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.039829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.039959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.040334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.040764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.240243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.243286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.248444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98263f49-c377-4913-bef2-231be6d4626a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223314 Aug 24 16:08:12.249003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1526/3024] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:12.251621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9eeca984-f84e-462c-8571-ddc2968afd31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225259 Aug 24 16:08:12.252380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1499/3025] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:12.253620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:12.254252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:12.260517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.261001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.261433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.262125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.262574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.263070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.323728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.333128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.335125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.336146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-039d8fd7-5a38-4f3d-891e-993c1358e149 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085896 Aug 24 16:08:12.339762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1527/3026] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:12.484809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:12.485977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:12.491668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.492160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.492596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.493291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.493744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.494169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.516939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:12.517549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:12.524267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.524741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.525180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.526544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:12.527010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:12.527440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:12.683439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.692917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ee0d85ee-0dea-467d-b7d0-5754d92b4478 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.210774 Aug 24 16:08:12.693499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1500/3027] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:12 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:12.705506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:12.714426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-666f5429-8e91-4a6c-a4fa-d74fdeb19975 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.201328 Aug 24 16:08:12.715023 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1528/3028] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:13.269746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:13.270416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:13.274062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:13.274681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:13.277134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.277641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.278059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.278756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.279210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.279651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.281174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.281667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.282108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.282816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.283274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.283742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.477003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.481108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.485228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-43401ca3-9253-4e03-9abe-0235efb86f5a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219372 Aug 24 16:08:13.485803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1501/3029] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:13.491210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:13.491837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:13.492845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f0103850-3731-49ca-931c-dbd0124ba087 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223905 Aug 24 16:08:13.494540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1529/3030] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:13.497799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.498340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.498773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.499462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.499939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.500575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.565304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.573876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.575355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.576507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9e23a77c-5100-4355-b39a-c33f8f0b48ed tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089807 Aug 24 16:08:13.577051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1502/3031] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:13.715201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:13.715904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:13.721769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.722250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.722682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.723393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.723875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.724999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.733991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:13.734593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:13.740529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.741001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.741430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.742119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:13.742566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:13.742982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:13.914273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.922750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-02b77722-cbba-4e17-b60c-20bca52949e2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.211259 Aug 24 16:08:13.923327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1530/3032] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:13 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:13.937297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:13.946209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cc310116-31f3-4d9a-a5b3-66a288cb1d83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215918 Aug 24 16:08:13.946773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1503/3033] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:14.508017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:14.508616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:14.513641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:14.514256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:14.515138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.515660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.516108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.516807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.517387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.517834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.521150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.521350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.521726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.522420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.523023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.523449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.715944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:14.725455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d1a2fbc-7669-41f0-909e-42bf362faf6d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221255 Aug 24 16:08:14.726054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1531/3034] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:14.727056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:14.730919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:14.731536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:14.735777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a84ffcff-60ce-45ae-b512-61b1d8b69606 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225791 Aug 24 16:08:14.736590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1504/3035] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:14.737372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.737873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.738315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.739104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.739487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.740678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.808397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:14.817132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:14.819066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:14.820241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f65b5c8d-bf7f-46b3-ab3a-10702db81b22 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093228 Aug 24 16:08:14.820802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1532/3036] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:14.944345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:14.944960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:14.951144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.951649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.952080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.952773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.953224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.953639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.968443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:14.969061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:14.976198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.976693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.977142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:14.977849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:14.978325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:14.978739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:15.151954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:15.155326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:15.161767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-db18d306-f4e1-4931-9cdf-18e061af9040 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221118 Aug 24 16:08:15.162353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1505/3037] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:14 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:15.163750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:15.172074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ca4fc5c4-bf5a-4302-9eda-0ffc76b60f77 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.207454 Aug 24 16:08:15.172627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1533/3038] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:15.751087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:15.751730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:15.758477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:15.758700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:15.759140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:15.759294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:15.759401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:15.760113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:15.760569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:15.761000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:15.765966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:15.766451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:15.766887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:15.767585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:15.768067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:15.768489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:15.956831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:15.961446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:15.965639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ae2b26fe-6d7d-4c49-b27f-2986f27cec0d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.211026 Aug 24 16:08:15.966291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1534/3039] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:15 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:15.970093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d6797d4b-77f1-476b-833c-017b411b993f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223477 Aug 24 16:08:15.970689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1506/3040] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:15.975936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:15.976810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:15.982997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:15.983485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:15.983960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:15.984656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:15.985105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:15.985526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:16.051527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:16.060345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:16.061843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:16.062982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-51285bab-b007-4ec7-a42b-9ce6263bef94 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095776 Aug 24 16:08:16.063531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1535/3041] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:15 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:16.181894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:16.182546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:16.189070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:16.189561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:16.190005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:16.190737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:16.191189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:16.191611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:16.193390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:16.193642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:16.199552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:16.200055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:16.200483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:16.201169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:16.201623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:16.202114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:16.396615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:16.398856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:16.406421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-110380e3-fad4-49fc-9949-40e947e2ec71 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.228420 Aug 24 16:08:16.407024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1507/3042] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:16 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:16.407201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a89f98b2-4a82-4af1-9deb-b571a2a3670b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217874 Aug 24 16:08:16.407840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1536/3043] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:16.992504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:16.993400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:16.994818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:16.995511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:16.999778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.000267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.000699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.001397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.001850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.002274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.003252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.003832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.004325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.005649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.006158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.006731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.199818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.207208 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.208693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9705d602-65ac-4bec-87f3-6300133292b3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223066 Aug 24 16:08:17.219784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1508/3044] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:17.219784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:17.219784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:17.220153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9f25d58d-878d-46f9-b79e-abdc97fa489e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227918 Aug 24 16:08:17.220153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1537/3045] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:17.222946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.222946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.222946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.223299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.223457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.223948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.290203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.298924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.300442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.301576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bdcab819-340b-4805-9794-24e2148540b2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091292 Aug 24 16:08:17.302784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1509/3046] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:17.428758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:17.429361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:17.429517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:17.429983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:17.435652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.436078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.436523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.436674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.437060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.437237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.437703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.437827 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:17.438151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.438275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:17.438575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.438700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:17.632845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.636669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:17.641142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c3c35ce0-faa6-48dd-8bd1-b6fe6a5ca378 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216664 Aug 24 16:08:17.641721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1510/3047] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:17.645182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-feaf5631-62ae-40a5-9600-641b48ca3825 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220805 Aug 24 16:08:17.645885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1538/3048] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:18.230548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:18.231167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:18.237751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.237936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:18.238346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.238506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:18.238659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.239354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.239847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.240540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.245317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.245795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.246269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.246963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.247412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.247864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.440646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.444081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.447535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:18.450139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e7637771-2a90-4e83-832f-f78c1c5df681 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223321 Aug 24 16:08:18.450721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1511/3049] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:18.453443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eeb8d7eb-1e9b-4888-a9c5-ea342215e8f8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219284 Aug 24 16:08:18.455672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1539/3050] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:18.455857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:18.456378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:18.462893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.463373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.463901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.464607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.465060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.465492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.526102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.534665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.536207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.537656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9deb8f09-eacb-44e0-bbaf-49a2445ff418 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086016 Aug 24 16:08:18.538229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1512/3051] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:18.662342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:18.663186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:18.666272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:18.666876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:18.669298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.669796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.670240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.670940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.671404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.671861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.672648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.673122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.673549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.674225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:18.674670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:18.675090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:18.886298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.893260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:18.894594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14404764-84c9-4c42-81dd-7b8fb8905f48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.236414 Aug 24 16:08:18.895164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1540/3052] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:18.902031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ccf1c7f8-904d-4e80-83cc-82be68495dcd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.239742 Aug 24 16:08:18.902600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1513/3053] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:18 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:19.475570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:19.476699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:19.477071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:19.477193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:19.482677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.483163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.483615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.484322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.484780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.485201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.486254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.486623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.487286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.488369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.489068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.489723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.679689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:19.686478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:19.687930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9369c8f-a18a-4cbd-8062-c25096217478 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.216748 Aug 24 16:08:19.688510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1514/3054] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:19.693720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:19.694332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:19.696640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-98885b2a-951a-4a9e-9f4d-526d3238566c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226656 Aug 24 16:08:19.697237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1541/3055] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:19.700337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.700824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.701263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.701948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.702400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.702819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.767398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:19.777134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:19.778624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:19.779797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b861fa6-e0e9-4836-aff9-5acaaeb894fe tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090330 Aug 24 16:08:19.780355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1515/3056] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:19.917396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:19.918012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:19.923868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:19.924348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.924506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:19.924631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.925034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.925738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.926198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.926628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.930677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.931164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.931596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:19.932377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:19.932856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:19.933277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:20.126795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:20.131893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:20.136601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b8870283-dd7d-4948-b817-f7313b5e1742 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223073 Aug 24 16:08:20.137180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1542/3057] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:20.140540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d84a56c4-d57a-4757-9a29-d09dd03231ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220449 Aug 24 16:08:20.141110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1516/3058] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:19 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:20.710643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:20.711247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:20.713549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:20.718150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:20.718769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:20.718886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:20.719332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:20.719803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:20.720507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:20.720961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:20.721382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:20.726001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:20.726495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:20.726936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:20.727658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:20.728130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:20.728558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:20.941197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:20.948837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:20.950119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fdb0d01f-38da-4be9-9cd8-fe3fbedb5f9d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.244149 Aug 24 16:08:20.950836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1543/3059] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:20.956520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:20.957124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:20.958711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a7ce55f9-fce7-41e1-9894-93300089d9bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.244007 Aug 24 16:08:20.959397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1517/3060] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:20 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:20.963477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:20.963935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:20.964393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:20.965102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:20.965563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:20.965994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.027952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:21.036608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:21.038262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:21.039408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-760a2d2b-367f-4b82-adef-beafda9c67a3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087785 Aug 24 16:08:21.039990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1544/3061] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:20 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:21.160655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:21.161869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:21.162748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:21.163796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:21.168765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.169456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.169700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.170243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.170476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.170909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.171114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.171341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.171916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.173131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.173940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.174703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.373053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:21.376343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:21.382157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-75ab761f-8d70-40c3-b691-fb0b5c69c601 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225316 Aug 24 16:08:21.382795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1518/3062] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:21.384852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c4c87994-9cff-43c2-9f9f-b4c0e12f084a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.226570 Aug 24 16:08:21.385441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1545/3063] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:21 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:21.972470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:21.973064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:21.975571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:21.980962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:21.981472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.981472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.981687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:21.981875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.982571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.983083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.983518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.987979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.988475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.988919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:21.989743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:21.990207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:21.990632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.173160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.181710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.186656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b4846b09-9c9b-4abf-8c4b-9f9c7008a87d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.209866 Aug 24 16:08:22.187136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1546/3064] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:22.188526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ddd0fba7-1a70-4311-841f-5a030f9ed6a0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219871 Aug 24 16:08:22.189270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1519/3065] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:22.191642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:22.192874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:22.199410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:22.199943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:22.200385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.201094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:22.201557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:22.202017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.265295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.274879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.276402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.277530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4d2ff915-62fa-44ad-baa6-7d3a15af73b1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089458 Aug 24 16:08:22.278082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1547/3066] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:22.402801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:22.403400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:22.407937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:22.408550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:22.409433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:22.409910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:22.410345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.411047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:22.411482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:22.411985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.415013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:22.415510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:22.416138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.416844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:22.417306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:22.417736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:22.617123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.620911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:22.625696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bfb34bb5-4fc8-47e1-8b27-206c66edb1db tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226711 Aug 24 16:08:22.626271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1520/3067] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:22.629260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1207c51f-81af-49a0-93fc-0fa6cdda8658 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.225164 Aug 24 16:08:22.629958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1548/3068] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:23.212115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:23.212934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:23.212934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:23.213541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:23.219522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.220032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.220505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.221190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.221477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.221632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.222065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.222193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.222690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.224392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.225079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.225685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.429072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.433102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.437382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5dec04f0-7252-4d28-9419-f54d7ab76b4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.231275 Aug 24 16:08:23.437948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1521/3069] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:23.441591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d53bf71-55d6-4142-9006-d78fce36aabf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.234936 Aug 24 16:08:23.442901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1549/3070] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:23.443039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:23.443663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:23.449628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.450301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.450729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.451409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.451880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.452299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.471530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:23.517628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.527956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.529513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.530654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b92dcacd-e3a4-47e6-b1ab-afcf23aa8f59 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091751 Aug 24 16:08:23.531212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1522/3071] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:23.649004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:23.649513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:23.650683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:23.651293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:23.655440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.655976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.656409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.657099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.657398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.657623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.657880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.658008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.658311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.658994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:23.659444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:23.659894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:23.852668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.863460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2ef893b9-9bfa-40b4-a0b6-87c61bc7f83d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218680 Aug 24 16:08:23.865264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1550/3072] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:23.865658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:23.875093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-efcaed37-ee95-4c72-b27e-d663931ee80d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.228668 Aug 24 16:08:23.875720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1523/3073] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:23 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:24.459384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:24.460079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:24.463264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:24.463965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:24.469947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.470467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.470909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.471032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.471507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.471669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.472099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.472281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.472531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.472987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.473448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.475055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.670561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:24.673515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:24.678965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e401044-60fd-4f58-856f-507d093fb8e4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223678 Aug 24 16:08:24.679666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1551/3074] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:24.682753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e38d38e8-1457-40e3-aebd-c85d834d68a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223296 Aug 24 16:08:24.683325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1524/3075] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:24.684191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:24.684852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:24.690553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.691038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.691468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.692226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.692722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.693315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.754318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:24.763002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:24.764516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:24.765645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-418002dc-5425-49c6-a744-408159071f45 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085187 Aug 24 16:08:24.766196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1552/3076] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:24.890079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:24.890688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:24.897461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.897949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.898384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.899080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.899530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.899978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.900215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:24.900851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:24.906937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.907434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.907904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:24.908728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:24.909198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:24.909661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.103170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:25.106402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:25.111562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-745eb92b-0010-4bbe-9910-f4136b20956c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225362 Aug 24 16:08:25.112170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1525/3077] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:25.115432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7c1f2979-92ec-4237-855e-da9d2ef2dbb2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.219834 Aug 24 16:08:25.116018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1553/3078] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:25.701727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:25.702328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:25.704119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:25.704726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:25.709915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:25.710396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:25.710832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.711528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:25.712011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:25.712183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:25.712431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.712671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:25.713108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.713800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:25.714252 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:25.714677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.913823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:25.918693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:25.922316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-227ee516-e7ab-47c6-a2f4-08ef0642e82e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225127 Aug 24 16:08:25.922898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1526/3079] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:25.927375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:25.927532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e34fdc94-0441-4d46-aeaf-6d9c92863d27 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227453 Aug 24 16:08:25.927997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:25.933819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:25.934300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:25.934727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.935410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:25.935886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:25.936307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:25.939962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1554/3080] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:25.998527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:26.007687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:26.009177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:26.010298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2dc9e4e6-96f0-44cd-8ae4-d54195e05b19 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086504 Aug 24 16:08:26.010847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1527/3081] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:25 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:26.133740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:26.134347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:26.136655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:26.137288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:26.140431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.140912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.141343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.142031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.142480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.142901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.143086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.143577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.144056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.144749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.145205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.146370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.340684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:26.344332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:26.349602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f0fc9674-f8bb-43c8-82ec-0740e461b972 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220166 Aug 24 16:08:26.350258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1555/3082] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:26.352929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fc06bf59-db1f-49b3-a7d9-e6d5322902a5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.219898 Aug 24 16:08:26.353511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1528/3083] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:26 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:26.944677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:26.945307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:26.948393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:26.949010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:26.951784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.952263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.952697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.953396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.953851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.954281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.956408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.956900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.957340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.959028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:26.959513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:26.959974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:26.974551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:27.150968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.155039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.159372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-68faa032-8d9b-4753-a040-2e500506b7e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218837 Aug 24 16:08:27.159978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1556/3084] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:27.163412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-13ee77c2-f2ad-4f4e-9122-61a27d9b9347 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218875 Aug 24 16:08:27.164180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1529/3085] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:27.164629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:27.165299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:27.171093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:27.171579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:27.172118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:27.173010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:27.173469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:27.173897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:27.236663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.245517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.247017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.248197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-338087ba-9702-4991-8e31-d1c91701d252 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087300 Aug 24 16:08:27.248750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1557/3086] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:27.370846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:27.371453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:27.374929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:27.375549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:27.377470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:27.377955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:27.378390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:27.379460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:27.380921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:27.380921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:27.382088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:27.382584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:27.383036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:27.383768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:27.384229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:27.384660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:27.588344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.591614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:27.597300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-48a3d4f8-d043-46a9-a4b8-fd9cfb1444de tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.226046 Aug 24 16:08:27.597930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1558/3087] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:27 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:27.600803 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fd602a8e-0ef9-4fe7-a23e-42185ac60b48 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.233794 Aug 24 16:08:27.601366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1530/3088] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:28.182671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:28.183356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:28.184078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:28.184698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:28.192282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.192790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.193008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.193222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.193916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.194087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.194366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.194726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.194852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.195942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.196418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.196854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.402605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.412201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.414446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-142054c2-4961-44f1-a8c2-22070e4b7482 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.235845 Aug 24 16:08:28.415070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1559/3089] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:28.419590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:28.420224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:28.421170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-947014e4-1e59-4fa2-a086-6c80fdedd89d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.240831 Aug 24 16:08:28.423688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1531/3090] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:28.427667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.428830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.429144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.430922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.431407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.431894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.499746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.510982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.513145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.514304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a5f69d37-7605-44f8-a8af-5e100889f8a7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098305 Aug 24 16:08:28.514864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1560/3091] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:28.621229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:28.621545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:28.621836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:28.622233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:28.628282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.628761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.629199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.630557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.631017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.631439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.632059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.632744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.633528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.634596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:28.635164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:28.635591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:28.888731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.896139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:28.899663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-835588a2-6ec6-49c7-aa74-c2167e71a9ce tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.282067 Aug 24 16:08:28.900337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1561/3092] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:28.909987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-693bf376-f648-4a3d-a533-6d795719c25a tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.292362 Aug 24 16:08:28.910579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1532/3093] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:28 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:29.436393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:29.437129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:29.442601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:29.443220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:29.443916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.444412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.444855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.445567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.446030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.446462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.449811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.450294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.450722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.451417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.451895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.452319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.865182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:29.873366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fafb1693-3626-4764-a20f-c37758d19762 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.440853 Aug 24 16:08:29.873945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1562/3094] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:29.878438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:29.879044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:29.884368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:29.885073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.885573 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.886017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.886743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.887204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.887741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.893064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9fb9c89d-e649-4a5f-90d4-ab3484806df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.454646 Aug 24 16:08:29.893639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1533/3095] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:29.922435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:29.923050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:29.930332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.930807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.931245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.931977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.932430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.932853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.951161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:29.961582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:29.963099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:29.964280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0e5a28c4-f6a9-4f5c-a0d3-7d63a16d3198 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089406 Aug 24 16:08:29.965077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1563/3096] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:29.972452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:29.972452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:29.977542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.978040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.978482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:29.979199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:29.979671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:29.980107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:30.113253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:30.122257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-86fe6dff-e97f-4b72-83be-ae0a0e60e052 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.203501 Aug 24 16:08:30.122948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1534/3097] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:30.146968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:30.155240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9885a4cf-d7f8-4738-a041-e2a9caa6de73 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.189200 Aug 24 16:08:30.155831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1564/3098] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:29 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:30.894709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:30.895360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:30.901907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:30.902383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:30.902810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:30.903509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:30.903978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:30.904396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:30.914972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:30.915599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:30.922519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:30.923019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:30.923458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:30.924200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:30.924663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:30.925116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.075765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.084559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b7f9619e-2247-44b6-8dc7-46b797f196ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.174072 Aug 24 16:08:31.085137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1565/3099] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:31.089616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:31.090298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:31.097080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:31.097080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:31.097399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.098040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:31.099199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:31.099662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.178317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.187065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.188586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.189730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1cdf03b3-4222-424b-9fd4-765d57694ec9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.103682 Aug 24 16:08:31.190294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1566/3100] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:31.194827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:31.195438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:31.201222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:31.201719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:31.202159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.202860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:31.203344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:31.203858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.220892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.229861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-432bcc03-b087-4e2e-9d6b-22c78a89d43e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.338999 Aug 24 16:08:31.230653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1535/3101] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:31.235155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:31.235789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:31.243122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:31.243616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:31.244156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.244860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:31.245350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:31.245774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:31.384424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.392867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f2a80564-b4cd-46af-b35c-b43b7b5789ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.201588 Aug 24 16:08:31.393468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1567/3102] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:31.415815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:31.423969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b813f74f-e705-45dd-897e-77d32c47c200 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.192363 Aug 24 16:08:31.425202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1536/3103] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:31 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:32.105541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:32.106216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:32.112702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.113191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.113629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.114892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.115404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.115862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.212647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:32.213254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:32.219914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.220397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.220831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.221526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.221975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.222425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.248604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.258168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-997d9a2b-a919-4377-a46a-858e94f8a2d8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.156475 Aug 24 16:08:32.258741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1568/3104] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:32.263612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:32.264249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:32.270322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.270818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.271257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.271987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.272441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.272866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.287880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.296577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.298079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.299218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c111e6ba-6d9c-458d-995f-4e61cf966764 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090626 Aug 24 16:08:32.299794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1537/3105] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:32.401689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.409703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-feb6296f-f099-4ee6-a66c-bc1e6afa5f6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.149885 Aug 24 16:08:32.411560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1569/3106] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:32.415031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:32.415691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:32.421877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.422365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.422825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.423515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.423998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.424427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.445036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:32.445634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:32.451425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.451939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.452360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.453043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:32.453489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:32.453905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:32.634489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.638676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:32.642953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-574fc316-86af-4e55-8940-a96c0034b8dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.232430 Aug 24 16:08:32.643843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1538/3107] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:32.647334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e6250fe4-d82d-4db8-b714-68f8aca01406 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.206210 Aug 24 16:08:32.647923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1570/3108] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:32 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:33.279272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:33.279914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:33.286276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.286754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.287185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.287900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.288346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.288786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.292727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:33.322744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:33.323346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:33.329906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.330396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.330837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.331826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.332281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.333357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.409528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.419284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.420859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.422045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e213d437-5c92-4d19-8aea-e065064536a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.103176 Aug 24 16:08:33.422604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1571/3109] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:33.433143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:33.434010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:33.439714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.440213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.440696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.441131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.441823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.442776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.443231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.449129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e3b1822f-2895-40f1-b6f0-fc3569781e67 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.173747 Aug 24 16:08:33.449698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1539/3110] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:33.574990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.583852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3c990f7-92cf-4320-bb7a-d51c67c2f5d4 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155183 Aug 24 16:08:33.584436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1572/3111] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:33.593308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:08:33.593490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:08:33.664294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:33.664917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:33.667880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:33.668490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:33.671343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.671583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.672062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.672766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.673220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.673648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.674365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.674836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.675276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.676000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:33.677372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:33.677942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:33.682012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:33.875542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.883213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:33.884413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b95e0dfb-44bf-49b1-b7b7-a5ba38321816 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223936 Aug 24 16:08:33.884987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1540/3112] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:33.891580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3e290c6f-24ff-487e-bcf4-68f71af3cdd1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.227395 Aug 24 16:08:33.892172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1573/3113] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:33 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:34.444954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:34.445606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:34.451989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.452469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.452907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.453595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.454071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.454495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.472244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:34.472859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:34.480071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.480568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.481004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.481705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.482167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.482599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.521663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:34.530817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:34.532343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:34.533490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6198cb4d-4f5c-4312-a4f8-b1f4bef002c5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092774 Aug 24 16:08:34.534049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1541/3114] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:34.635034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:34.643222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b473c86e-e87e-488e-bbc4-3b6f188eabb0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.174933 Aug 24 16:08:34.643829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1574/3115] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:34.740162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:34.740785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:34.746780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.747276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.747731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.748428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.748885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.749314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.881914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:34.890199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2d65f74-913b-4c38-8f62-72abaad9d10f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.288788 Aug 24 16:08:34.890773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1542/3116] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:34.906443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:34.907057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:34.912968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:34.913588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:34.914714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.915217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.915684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.916687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.917530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.918336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.921515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.922001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.922439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:34.923146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:34.923601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:34.924055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:35.124324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:35.127447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:35.133178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-62d217f4-84f5-4e0c-86a8-05720f46ca56 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230589 Aug 24 16:08:35.133756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1575/3117] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:35.136440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ee943614-65b2-4cd0-a3c0-71eea6efbf82 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.227514 Aug 24 16:08:35.136988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1543/3118] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:34 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:35.560601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:35.561207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:35.568059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:35.568541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:35.568993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:35.569702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:35.570131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:35.570549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:35.633915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:35.642642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:35.644204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:35.645608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d1d8004e-d263-4dda-b3d6-54a2a050c04c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090888 Aug 24 16:08:35.646169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1576/3119] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:35 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:35.665593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:35.666203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:35.672502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:35.672981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:35.673415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:35.674096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:35.674547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:35.674967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:35.808531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:35.816629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bf93df79-09cd-4d0d-bfbb-d2f774675b95 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154927 Aug 24 16:08:35.817152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1544/3120] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:35.918154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:35.918764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:35.924840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:35.925322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:35.925760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:35.926539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:35.926992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:35.927422 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.059289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.067433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-365145fd-f007-470c-9d06-e0f397ba7fc3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.153201 Aug 24 16:08:36.067965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1577/3121] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:36.154507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:36.155114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:36.157119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:36.157735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:36.161222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.161709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.162175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.162871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.163324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.163767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.163892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.164255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.164688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.165385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.165839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.166272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.382788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.386742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.391142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-449c04c2-4885-4362-9847-bb739b7ef078 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.240539 Aug 24 16:08:36.391721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1545/3122] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:36.395797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-33b8e58f-e5df-4fa4-86d1-d67372c4efbf tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.241697 Aug 24 16:08:36.396782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1578/3123] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:36 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:36.667346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:36.668082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:36.674377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.674859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.675292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.675999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.676943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.677366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.739243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.748505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.750000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.751140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2b6b6bc9-6080-4af7-9e38-1c10b161c178 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087692 Aug 24 16:08:36.751702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1546/3124] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:36.837555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:36.838176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:36.844689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.845185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.845630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.846336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:36.846906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:36.847209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:36.984228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:36.993583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6e65e788-7066-4a3b-a030-8e53b986c5f0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.159847 Aug 24 16:08:36.999679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1579/3125] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:37.088444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:37.089060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:37.095017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.095502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.095984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.096674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.097128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.097554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.230844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:37.239930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0fed243a-eaf8-4ca2-adf2-0221b219f2ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154484 Aug 24 16:08:37.240189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1547/3126] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:37.414353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:37.415307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:37.417582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:37.418202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:37.421591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.422085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.422520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.423215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.423713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.424181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.424329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.424663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.425101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.425795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.426661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.427095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.626564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:37.632086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:37.636288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-77370552-51ae-46d6-8303-23f0fd9f11ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226743 Aug 24 16:08:37.636867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1580/3127] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:37.640795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f66fe0e2-2498-4d5f-b84b-e692ea76568b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.226965 Aug 24 16:08:37.641359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1548/3128] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:37 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:37.773852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:37.774458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:37.781377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.781863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.782296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.784691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:37.784691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:37.784691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:37.853206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:37.862109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:37.863903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:37.864831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a157c682-5edb-4b67-8988-726f93b1848d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.094938 Aug 24 16:08:37.865381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1581/3129] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:38.015766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:38.016379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:38.023612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.024113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.024539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.025269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.025714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.026135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.155725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.164218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8450786e-1f90-46cb-a5dd-40ce271f3df9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152395 Aug 24 16:08:38.164781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1549/3130] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:38.261550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:38.262166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:38.268402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.268889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.269328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.270113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.270501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.270927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.414540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.423788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8307a268-8d09-4392-8719-1e52764e2c5a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.166016 Aug 24 16:08:38.424548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1582/3131] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:38.658107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:38.658731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:38.666162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.666392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.666829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.667535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.668024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.668453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.711299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:38.711953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:38.718278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.718907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.719211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.719937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.720393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.720815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.851828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.860033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e25d529d-e4fe-4a4f-8ac1-f3181d6a4a5b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.205768 Aug 24 16:08:38.860611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1550/3132] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:38.883484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.886413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:38.887059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:38.891891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4c149670-9ef3-4f1f-9157-c64110155ad5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.233359 Aug 24 16:08:38.892543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1583/3133] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:38 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:38.892949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.893482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.893920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.894629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:38.895682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:38.896281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:38.978422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.987071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.988715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:38.990430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-544021a8-8939-4d12-b5ad-28f55b4852eb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.107850 Aug 24 16:08:38.990986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1551/3134] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:39.188769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:39.189427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:39.196291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.196783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.197221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.197915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.198373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.198805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.334291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:39.343033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b3b3cb25-50f1-4196-93c8-f1006d43ad71 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158146 Aug 24 16:08:39.343601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1584/3135] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:39.447226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:39.447919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:39.454321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.454821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.455249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.456215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.456666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.457083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.589771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:39.601022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-873c9ef1-2d15-4698-95e2-f42856da77a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.158026 Aug 24 16:08:39.601630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1552/3136] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:39.881663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:39.882308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:39.889621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.890281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.890521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.891216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.891907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.892130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.914405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:39.915019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:39.921847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.922334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.922771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:39.923561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:39.924086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:39.924437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.040885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.048775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b091b171-6ada-4205-85cc-8470d15314c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.171771 Aug 24 16:08:40.049350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1585/3137] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:40.055028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:40.055659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:40.062054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:40.062551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:40.062993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.063730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:40.064191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:40.064615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.139045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.152637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.152998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.154258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.155482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-34f4b60c-986f-4b59-bcf0-933bc03dbfb7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.105211 Aug 24 16:08:40.156090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1586/3138] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:40.161820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e21ce503-e5a7-47c3-bc34-ab82b59dcf44 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.252075 Aug 24 16:08:40.162396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1553/3139] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:39 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:40.365584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:40.366307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:40.372355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:40.372838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:40.373270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.373955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:40.374407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:40.374828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.511620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.519957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-30a248dc-63e4-48e9-8c1f-f296b55aa757 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158629 Aug 24 16:08:40.520686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1587/3140] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:40.625405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:40.626045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:40.633151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:40.633632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:40.634066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.634755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:40.635209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:40.635657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:40.769115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:40.777442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e1853e64-f5cb-4ad3-85b9-511e994cf43c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155920 Aug 24 16:08:40.778015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1554/3141] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:41.071508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:41.072080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:41.078096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.078584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.079013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.079731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.080182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.080601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.177930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:41.178548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:41.184699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.185186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.185620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.186328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.186776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.187202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.261441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.264779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:41.271659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.273143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.274275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-96b7d7ac-d080-44cc-8d81-aa951b977945 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.100468 Aug 24 16:08:41.275016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1555/3142] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:41.279205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:41.279832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:41.286859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.287356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.287805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.288503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.288950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.289363 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.292858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.301859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4616d839-ee2e-4fd9-b0f3-0806b4b5522a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.234391 Aug 24 16:08:41.302442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1588/3143] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:41.418768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.426867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-49d24f88-aebd-49d1-995f-5fc427c8eda9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151100 Aug 24 16:08:41.427421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1556/3144] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:41 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:41.541655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:41.542288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:41.548154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.548642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.549075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.549767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.550217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.550719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.685239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.688615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:41.694955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2f2f66f0-4d99-42d3-bb4b-26fd50f4048f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.157192 Aug 24 16:08:41.695522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1589/3145] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:41.799194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:41.799842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:41.806449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.806933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.807373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.808087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:41.808541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:41.808964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:41.942216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:41.950391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-065dd27e-a083-4dd8-a071-e853e7934769 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155559 Aug 24 16:08:41.950985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1557/3146] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:42.297444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:42.298028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:42.305551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.306029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.306461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.307142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.307589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.308049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.324388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:42.324388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:42.330414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.331181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.331622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.332682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.333286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.333441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.379232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:42.387950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:42.389435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:42.390577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e079d0b4-8486-4b75-93f3-b40af745ea02 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097176 Aug 24 16:08:42.391128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1590/3147] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:42 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:42.447742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:42.448354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:42.454183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.454667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.455101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.455820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.456527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.456949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.476509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:42.484750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c057f296-eac4-4c4a-abe3-48c5fdad7edd tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.165775 Aug 24 16:08:42.485319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1558/3148] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:42.588591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:42.596734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8bcf2307-b243-4068-898b-bacc8955f8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.152798 Aug 24 16:08:42.597288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1591/3149] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:42 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:42.717199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:42.717811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:42.725006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.725501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.725944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.726645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.727097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.727525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.863368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:42.871488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9b62965-f754-4586-aa96-d40cd2d23d83 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158193 Aug 24 16:08:42.872078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1559/3150] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:42.973375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:42.974028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:42.981339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.981339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.981339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:42.981925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:42.982381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:42.982809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.113356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:43.122059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-73d916d5-686c-4261-b538-90c81f5ce7ef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152836 Aug 24 16:08:43.122627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1592/3151] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:43.414343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:43.414947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:43.421487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.422088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.422510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.423199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.423675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.424087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.487464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:43.496643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:43.498135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:43.499274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1507e68f-da67-43bb-a03a-cb35324dfde2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089106 Aug 24 16:08:43.499881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1560/3152] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:43.506658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:43.507362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:43.509811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:43.515089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.515578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.516041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.516733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.517186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.517653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.619847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:43.620453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:43.626515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.627002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.627441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.628161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.628615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.629111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.648575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:43.656747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0c9e7fcd-0f4b-4546-a0f7-c00ccb464c4b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154418 Aug 24 16:08:43.657306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1593/3153] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:43.760449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:43.769159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-78da30b8-ec12-480b-b5ee-f3a6def6b6d9 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153767 Aug 24 16:08:43.769835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1561/3154] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:43 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:43.893126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:43.893752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:43.900687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.901178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.901621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:43.902319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:43.902782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:43.903223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.039968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.048241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b47d00ab-8c6a-40a7-b668-bb0c8d076080 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158974 Aug 24 16:08:44.048813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1594/3155] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:44.144001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:44.145196 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:44.146456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:08:44.146627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:08:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:08:44.151448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.151969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.152417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.153113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.153565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.153990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.286509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.294659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dda8dcf3-9f67-4de2-b0d1-c9d0393ab4a1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154535 Aug 24 16:08:44.295220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1562/3156] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:44.524086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:44.524793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:44.531219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.531740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.532188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.532885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.533371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.533799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.595321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.604737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.606330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.607489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-069ddeab-a901-43c5-b5e5-7e896a193809 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088308 Aug 24 16:08:44.608068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1595/3157] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:44.678375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:44.679067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:44.685808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.686298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.686733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.687435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.687920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.688349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.790971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:44.791602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:44.798114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.798700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.799144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.799876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:44.800338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:44.801317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:44.825829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.834782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-40c6d057-b73d-48ea-a948-7638bfb689e7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160378 Aug 24 16:08:44.835361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1563/3158] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:44.932420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:44.940605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d25ff9b-51ab-4833-ad82-11d845bfd18f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.153531 Aug 24 16:08:44.941161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1596/3159] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:44 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:45.071849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:45.072438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:45.078458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.078945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.079393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.080124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.080575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.081257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.211354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:45.219470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f4050d26-ecd3-453e-a5b3-0c5ed8e27cd1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.151578 Aug 24 16:08:45.220064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1564/3160] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:45.316150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:45.316842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:45.322871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.323297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.323760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.324452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.324905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.325329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.454661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:45.463954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f61b6fbe-e3c7-4079-87c8-e87ad607acb5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.151586 Aug 24 16:08:45.464519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1597/3161] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:45.575000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:08:45.575245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:08:45.629022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:45.630138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:45.636968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.637454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.637919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.638671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.639156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.640281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.704844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:45.714514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:45.716030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:45.717153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9969364-cf94-4e77-b759-f94f156bc951 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092056 Aug 24 16:08:45.717700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1565/3162] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:45.855913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:45.856543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:45.862894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.863386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.864456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.865165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.865629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.866063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.962950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:45.963752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:45.970547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.970547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.970941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:45.971715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:45.972272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:45.972755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.002901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.012098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bda5c7ac-a4b4-4bee-8646-6ce4275833d0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160003 Aug 24 16:08:46.012675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1598/3163] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:46.106374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.114548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9d72cb19-ae4d-47ed-8742-d926af56bbfd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155607 Aug 24 16:08:46.115126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1566/3164] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:45 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:46.241430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:46.242038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:46.248072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:46.248559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:46.249585 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.249742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:46.250138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:46.250586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.381607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.389664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-645e3612-24ab-438a-a6e1-916c2d2e9ffb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152294 Aug 24 16:08:46.390213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1599/3165] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:46.486401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:46.487004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:46.493723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:46.494770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:46.494770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.495395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:46.496039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:46.496408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.625798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.634716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71da90fc-5e91-41c8-b1ac-870870f522a9 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152292 Aug 24 16:08:46.635207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1567/3166] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:46.740249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:46.740865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:46.747026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:46.747521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:46.748057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.748755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:46.749219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:46.749647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:46.812411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.821195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.822742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:46.823931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0abfeeb0-5350-44d8-92bb-0a6e28884681 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088264 Aug 24 16:08:46.824558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1600/3167] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:47.033588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:47.034202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:47.041345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.041829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.042264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.042959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.043409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.043880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.135860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:47.136593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:47.143134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.144384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.144384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.145623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.146153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.146652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.177591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.186179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5a686945-f576-411d-a006-842cc6293060 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156404 Aug 24 16:08:47.187170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1568/3168] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:47.286839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.295122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-04e623e9-c9b8-4266-ad8c-623c7704b8dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.163180 Aug 24 16:08:47.295686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1601/3169] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:47 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:47.411620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:47.412260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:47.414084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:47.419698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.420185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.420620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.421313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.421763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.422187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.565361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.575609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-16c735a8-6d1b-4c8c-adc9-e3f9ef2826a6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.167982 Aug 24 16:08:47.576320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1569/3170] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:47.656539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:47.657159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:47.664019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.664581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.665088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.665963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.666524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.667061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.800199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.809717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3b93f1a-a501-4bb5-8453-68e477f62f2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157409 Aug 24 16:08:47.810280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1602/3171] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:47.846406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:47.847013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:47.853119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.853606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.854106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.854738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:47.855186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:47.855624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:47.919234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.933107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.934709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:47.935956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9849353-fe23-4067-95ff-ead23f19e2a0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093425 Aug 24 16:08:47.936537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1570/3172] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:48.210332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:48.210960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:48.217469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.217954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.218381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.219062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.219509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.219953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.315914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:48.316514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:48.322882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.323369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.323854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.324556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.325013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.325436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.377177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:48.385693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-377a67cb-676e-496e-a0b1-499b86500346 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.179604 Aug 24 16:08:48.386272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1603/3173] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:48.462607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:48.470820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb0a6bd2-c405-4e92-88d4-9745aa728541 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.158837 Aug 24 16:08:48.471373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1571/3174] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:48 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:48.603179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:48.603901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:48.609804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.610312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.610750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.611548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.612078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.612499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.742986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:48.751088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c5089aa1-b7f1-45f3-b8d2-a7bf40e345aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.151778 Aug 24 16:08:48.751657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1604/3175] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:48.831494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:48.832774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:48.838653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.839135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.839561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.840266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.840733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.841158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.859994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:48.959746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:48.960400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:48.966296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.966781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.967214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.967932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:48.968385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:48.969022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:48.976462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:48.984572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-93947af0-bd6b-47cc-ab4c-d5a36608ce23 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157126 Aug 24 16:08:48.985138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1572/3176] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:49.031270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:49.040146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:49.041652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:49.042801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-330745be-6d8a-4f8c-8ee8-c4309ce81b48 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088120 Aug 24 16:08:49.043353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1605/3177] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:49.406239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:49.406888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:49.414195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:49.414685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:49.415132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:49.415857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:49.416313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:49.416742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:49.492841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:49.493457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:49.499534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:49.500061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:49.500498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:49.501196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:49.501652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:49.502108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:49.525172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:49.560220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:49.568596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-28845b2c-b6b3-4acd-affe-6d46534d8acf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.166224 Aug 24 16:08:49.569544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1573/3178] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:49.649420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:49.658414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-61526dcc-030f-4068-9102-1fd08a192fce tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.169831 Aug 24 16:08:49.659078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1606/3179] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:49 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:49.772108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:49.772755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:49.778681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:49.779163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:49.779603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:49.780699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:49.780854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:49.781184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:49.910815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:49.919963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e98aeab3-cee7-4542-ace2-224f3d261bd8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152298 Aug 24 16:08:49.920548 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1574/3180] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:50.007007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:50.007652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:50.017311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.017968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.018267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.019086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.020317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.020938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.065212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:50.065852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:50.073300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.073791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.074228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.074931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.075391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.075850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.148335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:50.157240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:50.158741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:50.159956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7558cca0-c51b-4d9a-95ab-0ac49bba6af9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.098639 Aug 24 16:08:50.161192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1575/3181] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:50 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:50.178579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:50.186859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-04b32249-dec2-4e8a-9d83-88f35ab00127 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.184517 Aug 24 16:08:50.187414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1607/3182] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:50.590375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:50.590898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:50.598031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.598505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.598946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.599649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.600098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.600517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.680567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:50.681424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:50.687974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.688475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.688919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.689628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.690090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.690518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.746758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:50.755688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a94188de-acef-41c1-9d50-48c1c2043b75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.169176 Aug 24 16:08:50.756267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1576/3183] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:50.833788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:50.842237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-38d6f849-20b1-40f3-a019-a479e19e8031 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.166170 Aug 24 16:08:50.842735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1608/3184] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:50 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:50.942828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:50.943440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:50.949532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.950021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.950461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:50.951155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:50.951661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:50.952192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.086511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:51.094742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2293155-a792-4790-8841-c72f299cf807 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.156508 Aug 24 16:08:51.095246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1577/3185] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:51.182512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:51.183125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:51.189248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.189742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.190183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.190875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.192507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.192963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.209743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:51.210477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:51.216390 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.216872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.217309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.218004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.218461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.218880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.258435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:51.267388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:51.268927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:51.271306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4ec1b74f-2383-48ed-b01e-9f15c44e8cf6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092722 Aug 24 16:08:51.271906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1609/3186] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:51 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:51.356014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:51.364144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-23397b67-f14c-4cde-bbd4-5983be0070e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159479 Aug 24 16:08:51.364704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1578/3187] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:51.776931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:51.777535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:51.783880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.784365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.784801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.785489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.786058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.786486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.865711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:51.866317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:51.872813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.873293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.873718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.874410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:51.874853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:51.875274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:51.933041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:51.942770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ff97fc8d-2a5a-4b62-9b8f-300058cd0792 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.169648 Aug 24 16:08:51.943361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1610/3188] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:52.022397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:52.032633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-574070cb-bddb-45fa-b095-7b0290e65711 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.171395 Aug 24 16:08:52.033213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1579/3189] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:51 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:52.116763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:52.117369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:52.123412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.123937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.124378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.125073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.125527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.125954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.255016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:52.263244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9b49312a-6a29-49cc-bcd7-c5223c8b13ee tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.151004 Aug 24 16:08:52.263838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1611/3190] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:52.294082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:52.294683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:52.300707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.301197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.301615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.302295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.302736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.303154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.368241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:52.376739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:52.378214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:52.379364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-214087a7-0b38-43f3-91df-36235b46ea01 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089157 Aug 24 16:08:52.379947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1580/3191] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:52 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:52.385833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:52.386438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:52.392382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.392832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.393339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.394021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.395158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.395590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.528373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:52.537206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9ea39555-3758-4376-b468-7230be945f16 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155090 Aug 24 16:08:52.537769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1612/3192] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:52.963990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:52.964682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:52.971379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.971998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.972941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:52.973675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:52.974130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:52.974551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.055114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:53.055762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:53.062243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.062738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.063273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.063909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.064391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.064820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.112163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.121169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c0ba586a-3701-41cc-9064-19a6708f41d7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160905 Aug 24 16:08:53.121735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1581/3193] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:53.201229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.212859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2c44e502-6478-4d08-bb6c-742295c71c5c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.162053 Aug 24 16:08:53.213564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1613/3194] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:53 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:53.284771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:53.285910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:53.291891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.292381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.292831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.293515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.293969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.294396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.401558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:53.402171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:53.408081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.408568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.409000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.409687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.410738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.411251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.422600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.432119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-89b80b50-6582-47fa-a586-9f3b84e487c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.151100 Aug 24 16:08:53.432695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1582/3195] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:53.474593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.483132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.484640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.485764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f11c2244-fc4b-40aa-9496-c390dd18823e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088078 Aug 24 16:08:53.486307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1614/3196] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:53 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:53.557987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:53.558588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:53.564547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.565016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.565447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.566146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:53.566568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:53.566983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:53.927093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:53.936958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-30f58008-ea73-452d-aef6-c67203c5e20e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.382737 Aug 24 16:08:53.937532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1583/3197] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:54.143649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:54.144971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:54.152035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.152644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.153190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.154065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.154669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.155132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.235556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:54.236288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:54.243077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.243570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.244040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.244749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.245200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.245624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.288092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:54.296439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-91e7fb6a-bb1c-4b97-b6ea-3194ef51fae8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156611 Aug 24 16:08:54.297019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1615/3198] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:54.393007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:54.402563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3dc74a4c-9ac7-4dc9-bc59-5b13b9c90a3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.170901 Aug 24 16:08:54.403130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1584/3199] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:54 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:54.453320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:54.454003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:54.461073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.461568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.462012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.462709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.463167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.463593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.508720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:54.509248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:54.515128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.515610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.516075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.516768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.517218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.517640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.587991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:54.596834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:54.598510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:54.599680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-15cb461b-e0d9-49c9-8b9d-4e0863cc3901 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.094964 Aug 24 16:08:54.600452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1585/3200] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:54 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:54.616819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:54.625079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ecfacfb5-0c33-40d9-aec4-6f2a06de576d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.175678 Aug 24 16:08:54.625629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1616/3201] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:54.958387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:54.958996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:54.964957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.965436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.965866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:54.966555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:54.967005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:54.967418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.109662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.118821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5dcf8f2f-53f2-4019-b9c9-4e415c6f1471 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.164600 Aug 24 16:08:55.119384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1586/3202] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:55.317561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:55.318182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:55.324962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.325465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.325906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.326620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.327080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.327508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.423915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:55.424629 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:55.432109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.432676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.433174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.433959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.434517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.435003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.460710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.469172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9803197f-82fd-495d-8d14-4d5ff313d807 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155915 Aug 24 16:08:55.469741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1617/3203] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:55.561962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.571258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d3e69c9e-da4b-4fd9-8f64-5876b59dd954 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151240 Aug 24 16:08:55.571851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1587/3204] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:55 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:55.622320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:55.622993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:55.629947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.630439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.630888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.631584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.632070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.632494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.646383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:55.647000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:55.652974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.653462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.653901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.654603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:55.655064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:55.655766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:55.699704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.709099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.710596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.711771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-40886286-9dd4-470f-9f75-dd74852944a4 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093358 Aug 24 16:08:55.712359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1618/3205] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:55 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:55.795161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:55.803940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b7678b11-8590-4654-b89e-b2408e2bca01 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.161474 Aug 24 16:08:55.804497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1588/3206] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:56.140048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:56.140667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:56.147559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.148083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.148522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.149212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.149679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.150107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.281586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.290885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e5fef39b-88a4-4120-90a1-27fa948bc1ca tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154737 Aug 24 16:08:56.291459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1619/3207] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:56.490627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:56.491178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:56.497799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.498301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.498741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.499443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.499933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.500362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.505656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:56.592267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:56.593026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:56.600302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.600800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.601244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.601975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.602440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.602869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.631639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.639968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-299cbadf-823e-489e-acde-c9df8c089ecb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153743 Aug 24 16:08:56.640549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1589/3208] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:56.731399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.734475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:56.735087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:56.739921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d42f0b30-20ea-4b9b-ada7-7ff766d9d1aa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.151376 Aug 24 16:08:56.740824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1620/3209] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:56 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:56.741640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.742128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.742567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.743280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.743760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.744193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.808900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.818328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.819858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.821044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-05c22e15-8812-4252-beda-cb8a4cf54fcf tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090515 Aug 24 16:08:56.821894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1590/3210] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:56 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:56.825058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:56.825675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:56.832701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.833185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.833648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.834345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:56.834838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:56.835264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:56.972800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:56.981006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-40958dca-9a46-4938-b2ec-b287b9242966 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.160288 Aug 24 16:08:56.981561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1621/3211] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:57.312799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:57.313413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:57.320098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.320579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.321016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.321705 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.322158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.322586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.450723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:57.459697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5804ef21-2b2f-40fb-991c-ef5162a87f05 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.150694 Aug 24 16:08:57.460289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1591/3212] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:57.663007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:57.663623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:57.670076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.670568 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.671007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.671758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.672218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.672646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.762357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:57.763108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:57.770813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.771341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.772014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.772730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.773341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.773826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.811676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:57.820796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8e35743e-0573-4937-8a78-a6515d282606 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.162305 Aug 24 16:08:57.821392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1622/3213] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:57.846279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:57.846279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:57.851948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.852450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.852895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.853610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:57.854074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:57.854504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:57.858866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:08:57.924864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:57.934051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:57.935759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:57.936939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ec0a23c0-d75d-44d8-a6fc-b3c8cb736070 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097200 Aug 24 16:08:57.937684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1623/3214] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:57 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:08:57.940535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:57.950133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1062383c-738c-4a98-ad4e-c1f5ba177b6f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.191550 Aug 24 16:08:57.950837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1592/3215] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:57 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:08:58.002962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:58.004088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:58.010055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.010539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.010971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.011676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.012123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.012731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.147498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:58.156239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1559b6d5-f2b7-4b68-95a0-2273137a2195 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.157115 Aug 24 16:08:58.156800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1624/3216] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:58.481086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:58.481693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:58.487582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.488646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.489073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.489806 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.490209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.490628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.620665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:58.629481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3c7a2ae3-6522-47d3-aa24-c84d14e50232 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152173 Aug 24 16:08:58.630075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1593/3217] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:58.843685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:58.844266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:58.851321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.851886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.852335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.853067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.853556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.853988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.963061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:58.963703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:58.970264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.970756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.971197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.971940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:58.973171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:58.973579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:58.996917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.005700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d35a08e-47eb-4b8a-abf3-58946a02c8f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.165919 Aug 24 16:08:59.006272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1625/3218] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:59.010716 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:59.011343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:59.017667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:59.018157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:59.018579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:59.019285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:59.019779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:59.020421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:59.043496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.052961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.054492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.055671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-66488df3-0d92-4901-b04f-f58fcb1eb5d1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.096507 Aug 24 16:08:59.056216 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1594/3219] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:08:58 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:08:59.155360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.164460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b6db7f3c-f2f3-4947-8447-31d1c5c946a2 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.157209 Aug 24 16:08:59.165026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1626/3220] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:59 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:59.178210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:59.178832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:59.184834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:59.185316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:59.185749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:59.186446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:59.186898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:59.187323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:59.320197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.328388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-88d97de9-861a-42d4-bb8a-26ae60948112 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154866 Aug 24 16:08:59.328943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1595/3221] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:08:59.651372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:08:59.652027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:08:59.657975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:59.658460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:59.658900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:59.659602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:08:59.660736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:08:59.661167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:08:59.795918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:08:59.804557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b45c5191-f2a0-4dc2-9f22-5737a1587a4c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157337 Aug 24 16:08:59.805125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1627/3222] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:08:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:00.028488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:00.029068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:00.036457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.036945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.037383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.038083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.038532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.038957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.079625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:00.080312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:00.088059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.088566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.089011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.089747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.090202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.090638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.167248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.177224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.178762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.179981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c81217ee-7522-4b2d-8bea-d2744f89a858 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.105236 Aug 24 16:09:00.180835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1628/3223] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:00 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:00.186158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:00.187075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:00.193684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.194183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.194624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.195330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.195825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.196260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.208411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.216930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-30761ded-d120-4176-b46a-614742d2e385 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.193224 Aug 24 16:09:00.217508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1596/3224] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:00.328540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.337569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0aa5d78a-de2d-425d-9de3-4da60bb9ef3b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.155327 Aug 24 16:09:00.338147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1629/3225] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:00 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:00.351199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:00.351994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:00.358011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.358495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.358932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.359646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.360105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.360535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.502838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.511830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b27fd62e-0489-4aa9-97cd-bef810f3201d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.165675 Aug 24 16:09:00.512396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1597/3226] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:00.828490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:00.829304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:00.837009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.837496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.837927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.838670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:00.839125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:00.839547 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:00.971133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:00.980201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fc705bdd-c5c3-4e8a-ba67-0f8e25ccb51e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157752 Aug 24 16:09:00.980820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1630/3227] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:01.202989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:01.203661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:01.211231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.211760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.212195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.212891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.213343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.213771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.238376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:01.239132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:01.246370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.246871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.247318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.248076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.248545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.248981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.279656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:01.290021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:01.291677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:01.293037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-981e0204-4021-4476-9635-07c8997ed557 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093902 Aug 24 16:09:01.293600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1598/3228] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:01 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:01.358537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:01.359765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:01.365122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.365775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.366208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.366894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.367340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.367788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.391717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:01.400638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-97322bd0-90a9-4b6b-b17e-501dc75a62e2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.166430 Aug 24 16:09:01.401212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1631/3229] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:01.496576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:01.505253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-850e8266-7a80-4f75-9b05-db1844d85f48 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.150496 Aug 24 16:09:01.505804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1599/3230] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:01 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:01.534121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:01.534816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:01.540735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.541222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.541661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.542348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:01.542803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:01.543227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:01.676541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:01.684638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f9d38142-321c-424d-bbae-46d964c1877f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154303 Aug 24 16:09:01.685196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1632/3231] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:01.810177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:09:01.810414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:09:02.004059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:02.004804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:02.010796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.011278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.011738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.012436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.013144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.013304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.142605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.152072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-601ad351-ff24-4226-a000-db6133f06906 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152738 Aug 24 16:09:02.152638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1600/3232] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:02.314845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:02.315452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:02.322448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.322929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.323360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.324069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.324517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.324936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.387132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.396571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.398056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.399182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-16eaae6c-5bfd-4f52-8bc0-81d37a683da0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088254 Aug 24 16:09:02.399767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1633/3233] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:02 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:02.421355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:02.421974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:02.428848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.429338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.429781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.431024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.431668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.432103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.526178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:02.526826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:02.532935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.533428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.533867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.534655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.535234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.535787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.570006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.578372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-441dec18-5981-41b5-8c0a-55fba48f203e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160757 Aug 24 16:09:02.578946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1601/3234] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:02.664074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.672279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-66f9e6d3-14b4-44df-9d64-5d9034a7f73f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.149930 Aug 24 16:09:02.672839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1634/3235] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:02 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:02.705666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:02.706674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:02.712723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.713203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.713645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.714324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:02.714773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:02.715190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:02.849004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:02.857228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7012ce4e-4822-4b65-bf3c-9982e7067924 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.155366 Aug 24 16:09:02.857793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1602/3236] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:03.173374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:03.173991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:03.180809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.181303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.181744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.182436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.182894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.183353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.317457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:03.326080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1796a113-e3bd-47cc-843d-3247585b972a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.156557 Aug 24 16:09:03.326643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1635/3237] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:03.422278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:03.422922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:03.429457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.429875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.430311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.430990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.431442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.431892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.493675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:03.502184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:03.503940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:03.505065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3ee5d88f-912b-4b28-a091-23e4c533ca0c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.086754 Aug 24 16:09:03.505604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1603/3238] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:03 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:03.600710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:03.601373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:03.607405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.607932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.608373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.609062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.609519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.609949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.693637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:03.694251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:03.700480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.700757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.701193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.701883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.702334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.702789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.754803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:03.763189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-45ee246a-2d81-4fac-842e-502f1b993f66 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.167424 Aug 24 16:09:03.763788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1636/3239] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:03.850285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:03.858495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e66e87b-5b58-43cb-a494-976d693c6f63 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.168734 Aug 24 16:09:03.859054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1604/3240] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:03 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:03.879621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:03.880281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:03.886468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.886955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.887395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:03.888128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:03.888591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:03.889022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.025920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:04.033954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b1bdaaf6-0070-4bdc-8d63-4b915dd85d94 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.159308 Aug 24 16:09:04.034542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1637/3241] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:04.349557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:04.350074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:04.356058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.356534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.356962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.357644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.358090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.358509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.498853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:04.502282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:04.508753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-84409ce5-f1c1-4f19-9401-f69c4712a657 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.164304 Aug 24 16:09:04.509318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1605/3242] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:04.527572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:04.528219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:04.535694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.536204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.536650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.537366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.537823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.538253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.604534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:04.614609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:04.616206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:04.617381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d71e84cc-2968-4e39-a3da-2c321f013c03 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.093750 Aug 24 16:09:04.617944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1638/3243] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:04 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:04.787565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:04.788247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:04.795058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.795576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.796040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.796743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.797194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.797616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.887155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:04.888296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:04.899169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.900094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.900815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.901927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:04.902683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:04.903448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:04.976025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:04.985054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5cfb9498-3999-417d-92cd-c589504dc505 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.202319 Aug 24 16:09:04.985641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1606/3244] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:05.055608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:05.056254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:05.061652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:05.062419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:05.062915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:05.063356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:05.064089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:05.064584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:05.065017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:05.065134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:05.072665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-632e0831-ee1b-4b2a-912d-3f17ff0ab981 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.196153 Aug 24 16:09:05.073256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1639/3245] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:04 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:05.198373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:05.207344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9b67b9eb-e04e-4d36-895b-14f32fd0b0d2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.155058 Aug 24 16:09:05.207939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1607/3246] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:05.530596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:05.531166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:05.537728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:05.538160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:05.538604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:05.539540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:05.539814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:05.540233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:05.640742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:05.641608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:05.648897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:05.649386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:05.649805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:05.650508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:05.650961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:05.651568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:05.686087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:05.695197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10f99035-8770-4d5c-a60e-dc836b4fbbfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.168713 Aug 24 16:09:05.695805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1640/3247] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:05.716000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:05.725464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:05.726941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:05.728108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-16685c57-2059-4bad-a76e-7acf6d223bb0 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091268 Aug 24 16:09:05.728655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1608/3248] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:05 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:06.009039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:06.009735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:06.016699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.017192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.017642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.018346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.019869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.020308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.095256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:06.096038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:06.103269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.103802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.104284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.104984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.105440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.105963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.196037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.204122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0a8f1d81-45b3-4637-b66c-3dc40fb7bc50 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.200686 Aug 24 16:09:06.204679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1641/3249] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:06.228512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:06.229140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:06.235040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.235535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.236029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.236736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.237197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.238204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.261590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.270063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-09906e2a-3f70-422b-af1d-3f192ac734ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.178783 Aug 24 16:09:06.270638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1609/3250] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:06 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:06.368737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.376797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b0b0b368-fa68-42ad-8054-4de4c0e50c42 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152108 Aug 24 16:09:06.377427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1642/3251] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:06.717095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:06.717717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:06.725289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.725776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.726218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.726919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.727375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.727839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.749652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:06.750262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:06.752623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:06.758181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.758678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.759117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.759842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:06.760301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:06.760755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:06.833451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.842305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.843875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.845082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fcab4945-8b9e-410e-91fd-b425b8095469 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.099245 Aug 24 16:09:06.845636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1643/3252] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:06 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:06.893131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:06.901425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-842afaf1-3710-40e9-ace7-b8f1be8c5898 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.188190 Aug 24 16:09:06.901987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1610/3253] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:07.227144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:07.227831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:07.233769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.234258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.234697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.235394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.235882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.236312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.291749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:07.292467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:07.298662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.299144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.299604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.300335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.300814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.301232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.411614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:07.420197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ed74cb3a-fa19-475c-a232-5a313cbc9b60 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.197616 Aug 24 16:09:07.420786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1644/3254] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:07.425203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:07.426545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:07.432304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.432797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.433241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.433947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.434405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.434835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.461237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:07.469670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7136ec25-6cbf-4879-85fc-909bcebabf58 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.181841 Aug 24 16:09:07.470326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1611/3255] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:07 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:07.563539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:07.572797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f6022518-0eb4-4e28-b590-325ad8d50d36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.151050 Aug 24 16:09:07.573371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1645/3256] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:07.867891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:07.868506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:07.874903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.875398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.875864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.876561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.877014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.877440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.923865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:07.924475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:07.931809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.932306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.932744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.933459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:07.933913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:07.934339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:07.944039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:07.952743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:07.954227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:07.955383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f816b6e9-ec73-42e4-8bdf-c29078e47cae tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091761 Aug 24 16:09:07.956971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1612/3257] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:07 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:08.075249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:08.084860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-16aab710-256d-4475-a368-c3ebd8373be2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.164920 Aug 24 16:09:08.085424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1646/3258] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:08.442218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:08.442818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:08.449941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.450432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.450875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.451603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.452084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.452509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.492144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:08.492771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:08.498986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.499472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.499975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.500698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.501147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.501565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.637094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:08.645432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-74e78e4e-188c-4420-bd8b-ee9ce4d83550 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.208076 Aug 24 16:09:08.646001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1613/3259] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:08.650539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:08.651144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:08.656956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.657443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.657878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.658561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.659008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.659521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.664924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:08.673129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ce8e08be-1c11-4dc3-b1f3-87fde84c4f3d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.185667 Aug 24 16:09:08.673698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1647/3260] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:08 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:08.787769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:08.796106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12098b4c-983e-48d1-956f-0f9727680356 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.149092 Aug 24 16:09:08.796674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1614/3261] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:08.978904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:08.979655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:08.986063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.986557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.986999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:08.988557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:08.989127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:08.989692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.052174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:09.060690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:09.062190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:09.063333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d1040961-6808-44e7-a174-77d2e2be34ef tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088404 Aug 24 16:09:09.063960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1648/3262] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:08 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:09.106361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:09.106964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:09.113959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.114423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.114846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.115528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.115998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.116424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.249795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:09.258429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-45295e62-178c-4237-90de-bfaf6122aacd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155892 Aug 24 16:09:09.258988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1615/3263] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:09.522026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:09:09.522282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:09:09.666278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:09.666900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:09.672955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.674298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.674756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.675860 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.676323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.676753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.694684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:09.695429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:09.702822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.702822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.703134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.703863 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.704316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.704847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.883799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:09.890756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:09.894687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5444f4e4-c286-4e2a-9491-b313614661fe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230895 Aug 24 16:09:09.895492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1649/3264] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:09.900319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:09.900929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:09.908636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.909125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.909609 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.910380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:09.910844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:09.911267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:09.912914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9e957799-2fe0-444a-8405-1cb4f2bf9460 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222187 Aug 24 16:09:09.913674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1616/3265] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:09 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:10.041431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:10.049534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-30fdaa0f-6517-461b-ba73-f55254d6f92b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152858 Aug 24 16:09:10.050591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1650/3266] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:10.086887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:10.087495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:10.093440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.093921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.094358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.095079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.095852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.096033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.159472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:10.168400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:10.169887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:10.171018 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ff1dc6e-e366-403a-a635-3cefc62e6d3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088012 Aug 24 16:09:10.171567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1617/3267] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:10 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:10.279981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:10.280700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:10.286698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.287186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.287623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.288337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.288792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.289215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.422302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:10.431508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-24e90e5e-96cc-4606-aa71-890d9779c075 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155442 Aug 24 16:09:10.432085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1651/3268] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:10 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:10.916448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:10.917062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:10.923175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.923690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.924138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.924883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.925348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.925763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.937779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:10.938404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:10.945536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.946033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.946480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:10.947210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:10.947706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:10.948140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.117580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.126418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d45594ef-5b8b-40aa-a651-1c9e1015125f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.213584 Aug 24 16:09:11.127495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1618/3269] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:11.133136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:11.133750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:11.137919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:11.138862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.141614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:11.142116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:11.142559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.143316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:11.144419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:11.144884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.150791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a7e539e4-96a1-4ea8-9650-1ee6904085b0 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.216873 Aug 24 16:09:11.151370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1652/3270] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:10 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:11.194293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:11.194993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:11.201051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:11.201537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:11.201977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.202661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:11.203114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:11.203536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.283448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.293098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.294643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.295980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ae02ace0-5db4-4278-8e34-2e6f6c33a95e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.106240 Aug 24 16:09:11.297120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1653/3271] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:11 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:11.299510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.308191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eaf510ed-d9f0-4d80-9ac7-7459cfb4b998 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.178860 Aug 24 16:09:11.308765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1619/3272] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:11.453171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:11.453785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:11.461015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:11.461504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:11.461947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.462646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:11.463102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:11.463529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:11.600028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:11.608221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cdb6b5dd-0206-41c6-9206-bb75e0d9ba01 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159504 Aug 24 16:09:11.608984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1654/3273] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:12.151675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:12.152325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:12.158558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.159054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.159591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.160338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.160797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.161230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.174654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:12.177007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:12.183660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.184170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.184608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.185317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.185794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.186212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.369085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.377438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-34c310c2-54d2-417e-a29d-cbf93e504309 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.229822 Aug 24 16:09:12.378642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1620/3274] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:12.381554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.383569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:12.384239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:12.389936 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.390270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd08bbf7-d03d-4c32-a819-c232c97e7221 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.221527 Aug 24 16:09:12.390586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.390952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.391832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1655/3275] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:12 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:12.391998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.392110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.392511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.397224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:12.397962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:12.404042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.404646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.405195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.405894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.406355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.406786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.426146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:12.463099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.472746 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.474281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.475437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7d6f0e0c-38cd-4dd3-8757-559d04bf5896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.095616 Aug 24 16:09:12.476044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1621/3276] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:12 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:12.552659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.560805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b5877227-36fc-4999-89e9-f0b9863608eb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.168062 Aug 24 16:09:12.561369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1656/3277] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:12.629831 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:12.630450 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:12.636534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.637053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.637488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.638184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:12.638640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:12.639068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:12.657701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:12.772376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:12.780603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5ed167b0-91a3-4751-b440-9ad4486a9017 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154698 Aug 24 16:09:12.781171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1622/3278] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:13.400088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:13.400700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:13.407243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.407773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.408219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.408923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.409775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.409775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.411887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:13.412522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:13.418589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.419075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.419511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.420235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.420690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.421114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.625244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.630229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.637067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4cb62a3a-84fd-4201-885b-cd243dece8d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.240784 Aug 24 16:09:13.637655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1657/3279] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:13.639689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-306b1be6-da04-4d8a-beb1-125d9e46c5dd tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.230839 Aug 24 16:09:13.640419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1623/3280] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:13 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:13.642522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:13.643309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:13.650496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.651288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.651962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.652865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.653322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.653837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.658805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:13.660554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:13.668432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.668922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.669358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.670054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.670508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.670931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.723116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.732035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.733538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.734688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bfc55725-b438-4af2-b6f3-c6a1e13ab896 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.096112 Aug 24 16:09:13.735346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1658/3281] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:13 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:13.803586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:13.804327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:13.810408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.810903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.811341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.812100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:13.812557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:13.812985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:13.818991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.830653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2bbff59e-1956-4393-abaa-70da6b78f4c1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.175114 Aug 24 16:09:13.831986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1624/3282] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:13.950683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:13.959776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6c406fae-d339-4399-8091-93564dd26430 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.161394 Aug 24 16:09:13.960341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1659/3283] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:14.658246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:14.658836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:14.661530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:14.662154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:14.666632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.667128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.667573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.668327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.668934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.669466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.669752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.670228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.670663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.671354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.671839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.672263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.869841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:14.872722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:14.878282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c7469945-b48f-4dcd-8189-278eaa568f4f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223641 Aug 24 16:09:14.878853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1625/3284] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:14.881588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-07c11502-049d-4efb-84f4-d1f7822dd4f1 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.223882 Aug 24 16:09:14.882479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1660/3285] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:14 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:14.883438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:14.884072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:14.890397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.890885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.891305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.892027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.892473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.892889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.900557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:14.901185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:14.907014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.907502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.908040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.908787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.909778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.910349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.958901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:14.967671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:14.969183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:14.970510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c558d6c5-d7e1-4a3d-9fc8-98f8d915ced8 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090725 Aug 24 16:09:14.971075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1626/3286] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:14 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:14.980670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:14.981356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:14.988440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.989258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.989716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:14.990426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:14.990888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:14.991320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:15.097666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:15.106095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dabc56e0-037a-4ef7-b5ed-8d716e7de2ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.209200 Aug 24 16:09:15.106668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1661/3287] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:15.144896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:15.153213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6221148-feb0-432d-908b-023432f58128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.176235 Aug 24 16:09:15.153774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1627/3288] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:15.900369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:15.900924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:15.905090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:15.905701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:15.907500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:15.908024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:15.908465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:15.909164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:15.910398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:15.910996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:15.912731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:15.913209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:15.913642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:15.914335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:15.914785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:15.915210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.103656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.110512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.112079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4e17a7b6-0511-4db0-b41c-afc85c72c857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215559 Aug 24 16:09:16.113449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1662/3289] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:16.117297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:16.118144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:16.119612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7e572347-0593-4c7d-bdc8-2af936447a1b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.218307 Aug 24 16:09:16.120422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1628/3290] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:15 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:16.125674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:16.126176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:16.126622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.127324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:16.127839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:16.128971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.131890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:16.132571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:16.138498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:16.138985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:16.139420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.140135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:16.140588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:16.141013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.201517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.212158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.213659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.214959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6fd82f43-13d4-436c-8f33-9d96625571be tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.101360 Aug 24 16:09:16.215532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1663/3291] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:16 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:16.220220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:16.221021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:16.229492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:16.230283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:16.230724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.231441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:16.231924 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:16.232358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:16.317146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.325411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3402b545-b9d8-4ee2-92bd-4c116bb5dd6e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.198061 Aug 24 16:09:16.325983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1629/3292] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:16.384472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:16.392685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cd104e3a-afe2-4f3b-b64e-17255a7b37fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.175973 Aug 24 16:09:16.393277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1664/3293] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:17.133564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:17.134177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:17.140736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.141222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.141662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.141807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:17.142358 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.142475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:17.142812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.143237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.149551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.150041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.150479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.151182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.151669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.152487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.338470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.342714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.347897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f5594326-7aef-428b-9a2b-0ef60b41dfe2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217347 Aug 24 16:09:17.348682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1630/3294] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:17.350910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f5c592c9-a434-4e38-9861-e47d4b8f2fa5 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.212894 Aug 24 16:09:17.355838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1665/3295] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:17 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:17.355997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:17.355997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:17.359790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:17.359943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.360365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.360809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.361021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:17.361515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.361967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.362457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.367930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.368421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.368861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.369560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.370017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.370442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.447996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.458208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.459756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.460916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fd328f91-7c4d-4aa8-b843-381a4c716a49 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.111524 Aug 24 16:09:17.461491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1631/3296] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:17 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:17.465796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:17.466409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:17.473036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.473528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.473969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.474672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:17.475128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:17.475621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:17.530451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.539298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-07e57023-229f-4726-bd77-2f67834036e0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.186836 Aug 24 16:09:17.539907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1666/3297] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:17.620569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:17.628889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-04cab436-08fa-43ba-aa8f-bceded03cebb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.166435 Aug 24 16:09:17.629463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1632/3298] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:18.369158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:18.369889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:18.373179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:18.373792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:18.376380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.376868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.377300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.378597 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.379070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.379488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.380497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.380978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.381412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.382104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.382552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.382975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.568870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.573074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.577111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-25a468b1-3cea-429b-8104-caa88b2f73e6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.211825 Aug 24 16:09:18.577688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1667/3299] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:18.582557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-55e4db21-c230-4073-b2aa-1417cc16ee32 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.212911 Aug 24 16:09:18.583148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:18.593118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1633/3300] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:18 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:18.593365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:18.593470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:18.593470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:18.593665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.593665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.593665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.593665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.594002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.594002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.595011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.595512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.595987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.596743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.597304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.597916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.668640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.677893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.679472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.680643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e0133c31-666d-40b1-8ae4-532186ae6fac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.102053 Aug 24 16:09:18.681954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1668/3301] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:18 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:18.685794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:18.686409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:18.692919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.693415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.693850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.694561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:18.695018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:18.695446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:18.787022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.797288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3d49f52e-e008-4fb8-a454-a5dd459c0ac8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.212594 Aug 24 16:09:18.797871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1634/3302] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:18.845594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:18.854736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-93131360-1221-4840-88bb-a3613c049ce5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.172546 Aug 24 16:09:18.855298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1669/3303] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:19.599571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:19.600306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:19.605086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:19.605737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:19.607031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.607584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.608078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.608878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.609384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.609840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.613560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.614065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.614505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.615206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.615686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.616150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.807009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:19.814177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:19.816444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bb724384-2aca-433d-bd3c-0aefee782f42 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220713 Aug 24 16:09:19.817023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1635/3304] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:19.824968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:19.825199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7667fa75-3515-48c5-9739-cb0bf71a1aa3 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222317 Aug 24 16:09:19.825324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:19.830153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.830633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.831497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.832193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.832643 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.832897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1670/3305] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:19 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:19.833150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.837951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:19.838678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:19.846092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.846619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.848886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.849675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.849675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.849896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.923614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:19.933901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:19.935382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:19.936587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2fbad82a-fa12-4d6b-95f5-971f97b909ca tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.118650 Aug 24 16:09:19.937140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1636/3306] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:19 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:19.941616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:19.942226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:19.948126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.948606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.949044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:19.949739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:19.950191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:19.950617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:20.041813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:20.050777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eb0322c5-e90e-4d29-b97f-56af7eb7abc7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.216127 Aug 24 16:09:20.051344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1671/3307] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:20.100360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:20.109368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c446dd1-8e33-446d-99d7-644c4037fb40 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.171289 Aug 24 16:09:20.109924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1637/3308] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:20.838992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:20.839576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:20.844779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:20.846054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:20.846335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:20.846826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:20.847260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:20.848329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:20.848690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:20.849034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:20.852317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:20.852799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:20.853244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:20.853940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:20.854471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:20.854931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.048795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.052531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.057778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-672b8d0d-60e1-4a37-905f-dc74e767da83 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222696 Aug 24 16:09:21.058530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1672/3309] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:21.060935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8c520b7e-e97b-4844-86e2-d74eaf9cae52 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.219867 Aug 24 16:09:21.063701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1638/3310] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:20 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:21.063869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:21.063869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:21.069693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:21.070248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:21.070748 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.071525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:21.072089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:21.072513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.072951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:21.073624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:21.076670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:21.080321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:21.080814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:21.081560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.082925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:21.083681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:21.084183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.089267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:21.148489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.157475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.158978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.160770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ac1da7a5-41cb-4245-b05b-6a35f8f1d6e3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.100763 Aug 24 16:09:21.161350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1673/3311] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:21 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:21.166000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:21.166607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:21.172903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:21.174360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:21.174360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.174604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:21.174970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:21.175399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:21.533597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.538167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:21.542007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-abb7dcc8-954c-43c5-91bf-eee176fb4233 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.474210 Aug 24 16:09:21.542588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1639/3312] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:21.546625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ddd174d0-ad86-4de7-8b8e-69f65e1f9ec5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.384228 Aug 24 16:09:21.547269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1674/3313] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:22.079229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:22.079921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:22.082113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:22.082726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:22.087212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.087755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.088198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.088896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.089140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.089439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.089627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.089933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.090047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.090729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.091178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.091598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.293179 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.297254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.303122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f20f1054-7a25-4be7-9e3a-280c268fb2de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.227979 Aug 24 16:09:22.303740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1640/3314] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:22.308461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a77bc045-a35d-49ad-a7e3-5ae100a594eb tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.229172 Aug 24 16:09:22.308657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:22.309281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:22.311853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1675/3315] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:22 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:22.319087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.319597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.320040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.320781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.321232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.321662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.385511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.394129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.395652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.396800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7abf8c11-d03c-4b5b-91ce-b3b30b7bcf62 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092129 Aug 24 16:09:22.397355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1641/3316] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:22 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:22.563486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:22.564126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:22.567807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:22.568442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:22.571680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.572160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.572591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.573283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.573740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.574164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.574291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.574777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.575215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.575944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:22.576404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:22.576848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:22.779111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.783197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:22.788313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a95b8e52-6de5-4388-b08d-a38dae5fcdfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228870 Aug 24 16:09:22.788898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1676/3317] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:22.791967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d136c4db-c096-4d9c-aa2f-07a75b92cec1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.228816 Aug 24 16:09:22.792530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1642/3318] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:23.326931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:23.328213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:23.330592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:23.331465 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:23.337072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.338019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.338019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.338711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.339173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.339607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.341136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.341625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.342064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.342761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.343220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.343658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.530958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:23.538271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:23.539866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-909b039f-81bb-45e0-a577-c4450433eb10 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216926 Aug 24 16:09:23.540444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1677/3319] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:23.544927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:23.545525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:23.546792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a640be32-0564-41f7-9f60-0604b038752f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220003 Aug 24 16:09:23.547534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1643/3320] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:23 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:23.551348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.552478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.552919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.553612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.554067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.554498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.615311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:23.623999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:23.625633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:23.626778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54c6d37e-bd77-4022-9fd6-e0ac2f57cc4a tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.085418 Aug 24 16:09:23.627355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1678/3321] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:23 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:23.809953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:23.810592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:23.813168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:23.813940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:23.818614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.819239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.819865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.820701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.821162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.821310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.821599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.821815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.822262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:23.823006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:23.823501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:23.824126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.017523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.028152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-777c462a-0f23-4f26-864c-12af4942dc07 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218404 Aug 24 16:09:24.029033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1679/3322] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:24.030355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.045346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-44900547-255f-46cf-9a29-2836cf696c32 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.239058 Aug 24 16:09:24.046384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1644/3323] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:24.561867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:24.562408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:24.569692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:24.570180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:24.570614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.570848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:24.571308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:24.571481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:24.571801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:24.572220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.577883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:24.578408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:24.578920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.579475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:24.579964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:24.580392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.767145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.774415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.777016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dfa1ff7d-08bd-458e-a98b-f0f900fd9865 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219040 Aug 24 16:09:24.777809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1680/3324] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:24.782203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:24.782786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:24.789236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:24.789732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:24.790175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.790876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:24.791330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:24.791783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:24.791910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9e5c334-b657-4dff-a374-4a1e91da07ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.225007 Aug 24 16:09:24.792411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1645/3325] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:24 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:24.857566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.866272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.867777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:24.868908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f737533-c721-492d-b1a3-774bfe70b69c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090399 Aug 24 16:09:24.869505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1681/3326] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:24 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:25.058161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:25.058764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:25.064879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.065367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.065830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.066131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:25.066543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.066743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:25.067612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.068212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.073360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.073854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.074298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.074992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.075447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.075902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.259732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:25.262868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:25.268509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7e5f34d6-8644-4c85-82a4-109d429b343e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.214056 Aug 24 16:09:25.269251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1646/3327] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:25 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:25.272433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b0712b2f-5c58-4003-a33d-015754d51ccf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.210049 Aug 24 16:09:25.272993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1682/3328] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:25.799380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:25.800053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:25.807253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.807781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.808225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.808926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.809479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.809915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.814436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:25.815056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:25.821538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.822036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.822483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:25.823189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:25.823686 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:25.824103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.009423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.017759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-43bf9571-5f71-4558-b810-ecabf778f287 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222281 Aug 24 16:09:26.018345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1647/3329] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:26.022983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:26.023595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:26.024086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.029706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:26.030204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:26.030644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.031341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:26.031829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:26.032258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.033138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-edac6c48-437a-4567-9460-afbb841a18bc tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222556 Aug 24 16:09:26.033706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1683/3330] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:25 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:26.096693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.109068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.110607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.111780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a1447441-5e2e-43dd-b2b5-953a07b89eac tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092494 Aug 24 16:09:26.112337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1648/3331] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:26 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:26.291392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:26.291950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:26.293217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:26.293841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:26.298620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:26.299207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:26.299739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.299985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:26.300489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:26.300616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:26.300935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.301123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:26.301550 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.301804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:26.302442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:26.302917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:26.503901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.508236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:26.513135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4d4d3dfa-b677-4374-8e66-7f2864c29609 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223646 Aug 24 16:09:26.513727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1649/3332] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:26.517892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9eeb2225-c06d-4c41-9418-4982474d8424 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.230401 Aug 24 16:09:26.518455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1684/3333] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:27.038667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:27.039346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:27.046123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.046609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.047047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.047783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.048291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.048844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.054691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:27.055299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:27.061652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.062134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.062565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.063259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.063801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.064561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.246589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.254783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-09b437ad-1264-4346-a231-a70ac4baeee4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220212 Aug 24 16:09:27.255542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1650/3334] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:27.268408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:27.268408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:27.268408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.268408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.268987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.268987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.268987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.269268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.269401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.277771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-209f8205-2b7a-4566-80aa-b7907ae8ab84 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.227334 Aug 24 16:09:27.278334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1685/3335] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:27 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:27.332098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.343268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.344841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.345997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d091797-08d6-4883-a78b-fd5331078379 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089514 Aug 24 16:09:27.346558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1651/3336] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:27 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:27.535396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:27.536225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:27.539596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:27.540274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:27.542970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.543461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.543928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.544630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.545088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.545514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.546339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.546796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.547264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.548000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:27.548459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:27.548888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:27.748038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.755673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:27.757067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0bbe5e0d-9600-4d33-be3e-a910f10bf579 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.225648 Aug 24 16:09:27.757761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1686/3337] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:27.764322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da72a147-400b-4f53-a6da-d63a3804d8aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.228570 Aug 24 16:09:27.764891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1652/3338] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:28.275146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:28.276048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:28.283334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.283862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.284300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.284994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.285444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.286621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.299446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:28.300094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:28.308476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.308968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.309416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.310144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.310604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.311110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.550461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:28.555494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:28.560945 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b9031b7-d34f-4333-9f8b-9d435185d20e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.289588 Aug 24 16:09:28.561532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1687/3339] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:28.563931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-99eb0d95-db6c-4b18-b471-1a21b4f488ae tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.268193 Aug 24 16:09:28.564498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1653/3340] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:28 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:28.570205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:28.570916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:28.577589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.578178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.578680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.579432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.579899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.580321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.652362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:28.663426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:28.664986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:28.666790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-edc45696-2727-4510-9d14-4828a3c41cfb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.104329 Aug 24 16:09:28.667354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1688/3341] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:28 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:28.778879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:28.779506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:28.785355 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:28.786272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.786788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:28.787133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.787959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.789128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.789604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.790076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.793887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.795650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.796227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:28.796992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:28.797457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:28.797893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.009232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.013762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.017984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:29.018324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-473b5552-883f-4540-9901-03e692102fc3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.243323 Aug 24 16:09:29.018915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1654/3342] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:29.025514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cb2a0638-f81e-4aba-8f0e-3656d2ac10ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.243977 Aug 24 16:09:29.026100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1689/3343] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:29.586772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:29.588031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:29.592399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:29.593016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:29.594673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:29.595165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:29.595594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.601001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:29.601001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:29.601001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.601371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:29.601724 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:29.602158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.602859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:29.603317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:29.603768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.798257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.801179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.802327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:29.808283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ad5689ad-e8ba-44bf-812b-ff8e6fe4217e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225559 Aug 24 16:09:29.809132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1655/3344] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:29.810363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ea0e1023-371c-4d70-9858-9b90242ce1fa tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222049 Aug 24 16:09:29.811049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1690/3345] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:29 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:29.813696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:29.814313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:29.821394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:29.821882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:29.822323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.823035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:29.823495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:29.823965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:29.885974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.894657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.896171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:29.897312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d50dbbd7-4e66-4a1c-a9f3-7538c2427e06 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087430 Aug 24 16:09:29.897864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1656/3346] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:29 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:30.045856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:30.046471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:30.050174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:30.050820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:30.053025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.053522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.053965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.055022 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.055160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.055537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.058019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.058510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.058951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.059807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.060307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.060743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.250204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:30.257142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:30.259264 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-344e97a4-403e-410d-91ac-55b2ffc04be4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217274 Aug 24 16:09:30.260086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1691/3347] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:30.265610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7f4e2852-cee0-4c69-a25d-19a99c4cf361 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.219199 Aug 24 16:09:30.266174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1657/3348] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:30 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:30.830190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:30.831153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:30.832237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:30.833401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:30.838440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.838934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.839377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.840108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.840412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.840553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.840898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.841057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.841329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:30.842028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:30.842477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:30.842916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.044227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.047747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.053238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5e7e8c9f-760e-49a6-8648-4bef447cd655 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226967 Aug 24 16:09:31.054077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1692/3349] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:31.056815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-150057d4-ec96-4718-91d1-d233640e325d tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.228611 Aug 24 16:09:31.057541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1658/3350] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:30 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:31.058466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:31.059079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:31.060893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:31.066608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:31.067758 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:31.068374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.069071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:31.069524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:31.069977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.131586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.140320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.141895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.143029 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fe7ff9b7-f9c6-4e29-a9a8-bf816aaa0c24 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088171 Aug 24 16:09:31.143588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1693/3351] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:31 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:31.280403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:31.281097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:31.286322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:31.286940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:31.287147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:31.287649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:31.288095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.288793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:31.289241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:31.289667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.293075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:31.293571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:31.294015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.294775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:31.295182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:31.295619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:31.486633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.495673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2d57df34-4f55-44a0-8c93-5193d7be0283 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219014 Aug 24 16:09:31.496169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1659/3352] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:31.498323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:31.506925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7aa39b7a-cde5-4a04-9e18-7ce87bdef752 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224593 Aug 24 16:09:31.507575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1694/3353] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:32.074515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:32.075070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:32.078153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:32.078799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:32.082025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.083085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.083538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.084491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.084957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.085386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.086958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.087450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.087917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.088622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.089086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.089520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.283817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.288397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.292884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b5f34068-6248-4968-9ccb-905ef3b0c609 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.218469 Aug 24 16:09:32.293534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1695/3354] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:32 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:32.296653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-273d423c-fe6c-4483-8dde-1d7c280b49ab tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226110 Aug 24 16:09:32.297372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1660/3355] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:32.298259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:32.298879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:32.305557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.306050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.306492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.307194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.307674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.308108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.371428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.380291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.381795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.382942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-49b3d5bc-aa32-47ee-a7eb-73da57684bb9 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088486 Aug 24 16:09:32.383504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1696/3356] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:32 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:32.516979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:32.517603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:32.524364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.524853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.525294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.525993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.526447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.526875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.528122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:32.528740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:32.534820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.535333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.536418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.537101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:32.537555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:32.537986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:32.724345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.727579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:32.732693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bafa3286-9738-4503-9923-915e31ed2ae7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219722 Aug 24 16:09:32.733354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1661/3357] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:32.736050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3b86f246-16e7-44c5-92f7-4d4a8b2d66b8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.211962 Aug 24 16:09:32.736677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1697/3358] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:33.315095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:33.315783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:33.318737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:33.319363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:33.322497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.322993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.323428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.324168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.324630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.325058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.325729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.326221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.326661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.327369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.327891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.328328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.521306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.525274 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.529855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7815428-aa8a-4d1e-8347-faa49057eeb8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215532 Aug 24 16:09:33.530521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1698/3359] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:33.533732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-50a66d6b-629b-4f6a-9463-aaea6a851c46 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222450 Aug 24 16:09:33.534289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1662/3360] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:33 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:33.535288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:33.536522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:33.542583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.543143 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.543674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.544455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.544941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.545370 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.607948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.616632 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.618121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.619255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b1c0991-00c2-4437-85fe-0dbf49d4bf3f tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087845 Aug 24 16:09:33.619838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1699/3361] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:33 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:33.753689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:33.754917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:33.757483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:33.758090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:33.761669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.762160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.762605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.763305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.763790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.763983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.764221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.764469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.764932 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.765587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:33.766092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:33.766526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:33.964171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.971774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:33.976139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e8f5769-6e8a-4a4f-a4ce-012fe6775f50 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222936 Aug 24 16:09:33.976719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1700/3362] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:33.980203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cafece0b-a891-47fb-8ddc-e90354f1cf0f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230321 Aug 24 16:09:33.980769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1663/3363] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:34.553952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:34.554564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:34.554687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:34.555320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:34.561183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:34.561677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:34.561897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:34.562285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:34.562414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:34.562732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:34.563006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:34.563438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:34.563557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:34.563909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:34.564033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:34.564339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:34.760335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:34.763459 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:34.768940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-367cf20b-8cce-4470-acbd-098451563109 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221055 Aug 24 16:09:34.769517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1701/3364] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:34.772889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1946e1b8-0398-49e0-9802-fbb7475dd523 tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.222564 Aug 24 16:09:34.773712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1664/3365] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:34 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:34.774762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:34.775368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:34.781401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:34.781959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:34.782451 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:34.783195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:34.783661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:34.784085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:34.850985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:34.859671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:34.861211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:34.862396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54dc6716-f0a5-4183-adf8-4378c47d89aa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.091430 Aug 24 16:09:34.862901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1702/3366] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:34 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:34.997799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:34.998321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:35.001215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:35.001838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:35.004520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.005006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.005435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.006127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.006571 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.007000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.007992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.008489 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.008928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.009629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.010090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.010523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.209228 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:35.213203 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:35.217461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1f0e71ee-2826-4bd9-8321-bc962eb9038b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223547 Aug 24 16:09:35.218037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1665/3367] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:35.221640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d8a47108-00f5-4da8-aaa7-8dc80cef9e1f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224317 Aug 24 16:09:35.222206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1703/3368] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:35.790734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:35.791350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:35.794248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:35.795035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:35.798102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.798667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.799140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.799873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.800336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.800766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.802156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.802886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.803325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.804056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:35.804511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:35.804936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:35.994745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:35.998169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:36.002953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-371a0ee4-3f88-4294-a4ba-c5642f6cfbcb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216258 Aug 24 16:09:36.003518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1666/3369] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:36.008027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-272853c7-f4b5-4141-ba0a-c0da84d81b3f tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.217666 Aug 24 16:09:36.008583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1704/3370] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:35 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:36.011381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:36.012467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:36.022330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:36.023307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:36.024107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:36.025388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:36.026225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:36.026971 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:36.101789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:36.110500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:36.112066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:36.113199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e4c9cca5-a9ae-472a-a8ee-cb69fae572b5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.108753 Aug 24 16:09:36.114400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1667/3371] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:36 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:36.239866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:36.240491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:36.242575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:36.243137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:36.246525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:36.247019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:36.247462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:36.248195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:36.248657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:36.248958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:36.249084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:36.249445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:36.249878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:36.250567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:36.251022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:36.251526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:36.450736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:36.458460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:36.459973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fa510095-8c2a-4ce2-911b-9f4a011dc5f0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224175 Aug 24 16:09:36.460574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1705/3372] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:36.467392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7ef0b6a8-0535-4dda-908a-4fb001a7d520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228904 Aug 24 16:09:36.467995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1668/3373] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:37.025377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:37.026151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:37.030146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:37.030748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:37.032721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.033024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:37.033213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.033655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.034525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.035007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.035571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.039024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.039518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.039986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.040695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.041151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.041582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.055781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:37.239549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.243765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.248287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4f3e9ed7-49fd-4a89-b58e-ca37d858c326 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.227548 Aug 24 16:09:37.248998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1706/3374] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:37.251980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dddb8550-2391-42f5-9cb2-cb80818bf8ef tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.225527 Aug 24 16:09:37.252539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1669/3375] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:37 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:37.253965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:37.256000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:37.262033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.262600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.263134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.263877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.264339 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.264769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.327987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.337359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.338909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.340094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c2b4a398-4cb6-4570-bfc2-96367f30cd95 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.090040 Aug 24 16:09:37.340651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1707/3376] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:37 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:37.483353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:37.483353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:37.488375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:37.489268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.489604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:37.489780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.490195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.490896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.491559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.492059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.495465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.495973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.496402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.497089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:37.497540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:37.497959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:37.686295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.695357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dec2508d-0ba1-4b18-bac2-1262f48bf11c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.217329 Aug 24 16:09:37.696328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1670/3377] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:37.698496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:37.707064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6354eab7-9a1e-408a-9aea-b86b14e5339c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222434 Aug 24 16:09:37.708710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1708/3378] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:38.269508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:38.271016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:38.274280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:38.274897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:38.277591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.278075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.278510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.279199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.279674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.280103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.281344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.281864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.282304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.282997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.283453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.283903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.480793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.486606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.492139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fa8a7159-7988-415f-be15-32b7a6e95e2a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226434 Aug 24 16:09:38.507834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1671/3379] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:38.508060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-48ab265f-bc33-4014-b8b5-b5542dd7ba6c tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.225993 Aug 24 16:09:38.508060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1709/3380] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:38 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:38.508277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:38.508277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:38.508277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.508277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.508689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.508689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.508689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.508689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.526304 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:38.573231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.582734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.584850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.586028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-80b1834a-c908-4fc2-a25b-b371a5f5812e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092332 Aug 24 16:09:38.599657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1672/3381] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:38 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:38.718466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:38.719076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:38.725570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.726064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.726510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.727210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.727690 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.728123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.728950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:38.729563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:38.735516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.736032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.736472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.737162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:38.737619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:38.738062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:38.933642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.937021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:38.942737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c5b9c55a-c5d7-498d-85e3-24d2cbeacd2c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.227551 Aug 24 16:09:38.943326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1710/3382] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:38.945118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-80512b00-dbc2-4107-bf75-0fadb78845a4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219920 Aug 24 16:09:38.945678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1673/3383] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:39.523900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:39.524527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:39.529489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:39.530112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] [instance: f68e3c94-e105-482d-916a-1e70d8b64373] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:39.531226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.531761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.532205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.532907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.533371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.533803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.537814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.538302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.538744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.539449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.539941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.540375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.731864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:39.735525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127f047b72c443eab061a22b1155e053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b9035514b74d60b49d9d7e404d3b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:39.740593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f150c5c-616b-4272-bff3-7077f3b32fe8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221462 Aug 24 16:09:39.741521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1711/3384] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:39.746045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:39.746332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2f86def-4aa6-4f4e-b3d3-33c584b1fe6b tempest-VolumesSnapshotTestJSON-836539461 tempest-VolumesSnapshotTestJSON-836539461-project] 10.222.0.102 "GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373" status: 200 len: 1563 microversion: 2.1 time: 0.220505 Aug 24 16:09:39.746846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:39.753292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.753869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.755001 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.755972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.756671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.757297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.759999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1674/3385] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:39 2022] GET /compute/v2.1/servers/f68e3c94-e105-482d-916a-1e70d8b64373 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:39.822035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:39.832087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:39.833728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:39.834910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5556a769-1a9b-4025-8ce1-c58d06df11c7 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092652 Aug 24 16:09:39.835479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1712/3386] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:39 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:39.965219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:39.965988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:39.966530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:39.967168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:39.972569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.974142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.974345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.974679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.974868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.975292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.975412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.975913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.976196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:39.976377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:39.976662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:39.977096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:40.168718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:40.177362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-132c144c-3d24-44d1-b6df-e27f7c9e2554 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.214988 Aug 24 16:09:40.177955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1713/3387] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:40.181508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:40.191263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-adc7d2e2-3a9b-4e1b-b3f2-b74e78f67f4e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.230397 Aug 24 16:09:40.192015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1675/3388] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:40.768770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:40.769382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:40.776139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:40.776629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:40.777076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:40.777787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:40.778251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:40.778681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:40.861794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:40.862401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:40.869720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:40.870210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:40.870645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:40.871352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:40.871835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:40.872266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:40.919677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:40.929042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-64b7daea-4443-4300-8250-80ec38f5a294 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.164192 Aug 24 16:09:40.929623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1714/3389] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:40.937153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:40.946712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:40.948282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:40.949448 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aff95e99-a6f6-491e-ab12-508a2fa77839 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092131 Aug 24 16:09:40.949996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1676/3390] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:40 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:41.198475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:41.199130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:41.205164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.205658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.206387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.207081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.207943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.208141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.212917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:41.213543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:41.219335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.219854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.220362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.221064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.221518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.221947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.400912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:41.409276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2a7c3c49-185e-476f-8801-f69009587f41 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.214472 Aug 24 16:09:41.409668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1715/3391] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:41.412462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:41.421296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-32f80486-a1fc-4719-8eec-8e81c3bd7272 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.212203 Aug 24 16:09:41.421861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1677/3392] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:41.950966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:41.951529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:41.959158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.959658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.960093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.960779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.961233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.961656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.972225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:41.972919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:41.979415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.979937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.980382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:41.981079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:41.981538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:41.981966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:42.301399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:42.310267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:42.311796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:42.312947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ad34a3e1-f6d8-4e8c-9ecd-a4eace42030e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.344606 Aug 24 16:09:42.313506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1678/3393] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:41 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:42.362193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:42.371375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7d03bc8a-80db-4b8f-9ff6-e446d5192da8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.424283 Aug 24 16:09:42.371976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1716/3394] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:42.430404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:42.431023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:42.437022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:42.437589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:42.438023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:42.438752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:42.439214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:42.439668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:42.442991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:42.443659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:42.449557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:42.450044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:42.450483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:42.451179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:42.451651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:42.452088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:42.635460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:42.639469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:42.643989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-16b6b569-4f08-4004-903a-b662dcaa7053 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218029 Aug 24 16:09:42.644573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1679/3395] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:42.648448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-31ad17ad-f2e2-45c1-8525-49e9f47e8a2b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.210054 Aug 24 16:09:42.649019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1717/3396] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:43.337082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:43.337704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:43.344124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.344601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.345031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.345716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.346159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.346586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.393813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:43.394426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:43.401666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.402160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.402598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.403297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.403787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.404218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.408928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:43.417652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:43.419155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:43.420344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-07c69a65-072e-4091-b853-b0c61b5d9539 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.087233 Aug 24 16:09:43.420911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1680/3397] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:43 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:43.533571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:43.541859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bedc3dae-55e4-4aef-844e-4a27fc63976f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.152058 Aug 24 16:09:43.542427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1718/3398] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:43.665723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:43.666332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:43.670220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:43.670833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:43.672382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.672857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.673287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.673970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.674415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.674837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.677497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.678120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.678432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.679133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:43.679596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:43.680044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:43.877048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:43.880270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:43.889029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b9e1b8ca-e96d-4e92-87ac-8ab9f8c83711 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227140 Aug 24 16:09:43.889615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1681/3399] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:43.890540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d83a383b-5035-47a4-8c36-c5775d9b54ac tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224039 Aug 24 16:09:43.891254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1719/3400] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:44.442036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:44.442765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:44.449857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.450341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.450781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.451470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.451947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.452375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.518740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:44.527547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:44.529069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:44.530200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ddaf681-0929-4a04-b293-05e9451f8339 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.092081 Aug 24 16:09:44.530754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1682/3401] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:44 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:44.562458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:44.563068 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:44.570306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.570794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.571233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.571959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.572424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.572852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.701091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:44.709662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-db3aa46a-7bd9-4cd1-b081-d605a3f170e0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151010 Aug 24 16:09:44.710260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1720/3402] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:44.910773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:44.912070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:44.913139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:44.913754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:44.918848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.918848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.919190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.919883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.920036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.920348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.920475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.920775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.920890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:44.921462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:44.921911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:44.922331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:45.123797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:45.127803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:45.132327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f4f7445e-1e9b-4740-ac29-1ef6b02159ec tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.225385 Aug 24 16:09:45.133139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1683/3403] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:45.136592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0a32377a-6aa9-4006-a071-0be8b63a0cbf tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.227762 Aug 24 16:09:45.137163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1721/3404] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:45.553053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:45.553670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:45.560077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:45.560560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:45.560997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:45.561687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:45.562143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:45.562570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:45.634684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:45.643385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:45.644913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:45.646751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-95da4542-fb2a-481d-8a18-05ba87d38e36 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.097774 Aug 24 16:09:45.647328 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1684/3405] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:45 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:45.730310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:45.730930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:45.737385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:45.737874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:45.738319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:45.739011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:45.739472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:45.739929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:45.875049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:45.883693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b9c9a2f-5843-41fe-ab4b-7beabeb152f1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157154 Aug 24 16:09:45.884297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1722/3406] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:46.153321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:46.153972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:46.158148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:46.158768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:46.160069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.160562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.160998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.162194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.162656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.163087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.165744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.166236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.166672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.167400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.167896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.168330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.172603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:46.360749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:46.363219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:46.371002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5bedf275-80f3-45a5-a34d-e23b168d583a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221637 Aug 24 16:09:46.371586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1685/3407] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:46 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:46.372518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7573affa-95b3-4c1c-bb01-473302bd5cdc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218127 Aug 24 16:09:46.373073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1723/3408] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:46.668907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:46.669516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:46.676275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.676825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.677860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.678650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.679107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.679535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.741987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:46.750672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:46.752245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:46.753392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bedc0bd3-8df8-43c6-9c2f-d7aa00c96925 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.088409 Aug 24 16:09:46.754201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1686/3409] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:46 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:46.906053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:46.906653 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:46.914123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.914619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.915060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:46.915804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:46.916263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:46.916694 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.048405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:47.056715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-db629d75-9548-4610-b67a-34b28392bf64 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154544 Aug 24 16:09:47.057277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1724/3410] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:47.393474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:47.393742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:47.394095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:47.394682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:47.401327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:47.401818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:47.402259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.402964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:47.403426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:47.403887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.404145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:47.404874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:47.405538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.406591 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:47.407287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:47.407976 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.594395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:47.601156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:47.602509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d4cff0a6-bf9f-48a5-9a1c-64de5bcfc00f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.212816 Aug 24 16:09:47.603091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1725/3411] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:47.610096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-54e58110-a1e8-40c9-85f6-e961a9cf668c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222139 Aug 24 16:09:47.610737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1687/3412] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:47.777096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:47.777709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:47.783693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:47.784184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:47.784627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.785325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:47.785783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:47.786737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:47.851533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:47.860356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:47.861861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:47.863003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-093130b4-68b5-4a90-a087-10488ae5deaa tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 200 len: 1447 microversion: 2.20 time: 0.089890 Aug 24 16:09:47.863558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1726/3413] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:47 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 1447 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:47.886066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7ef80b94-5cb6-4a9c-8a41-9c7cedf94153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '.version_select at 0x7fc5cd4c85e0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:47.908334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7ef80b94-5cb6-4a9c-8a41-9c7cedf94153 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379967176" status: 204 len: 0 microversion: 2.20 time: 0.026083 Aug 24 16:09:47.909080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1688/3414] 10.222.0.102 () {60 vars in 1264 bytes} [Wed Aug 24 16:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379967176 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:09:48.080140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:48.081308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:48.088929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:48.089151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:48.089978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:48.090688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:48.091248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:48.091800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:48.337627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:48.346389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-63730e89-d170-4ece-97b3-3b4af3dfa5b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.271921 Aug 24 16:09:48.346963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1727/3415] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:48.624148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:48.624876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:48.632214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:48.632829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:48.639125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:48.639670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:48.640322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:48.641207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:48.641438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:48.641932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:48.642356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:48.642493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:48.643081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:48.643345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:48.644065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:48.644212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:48.854032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:48.857420 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:48.862695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-94bde1c2-55b6-410b-83ad-86a3cf72ac02 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.242379 Aug 24 16:09:48.864713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1689/3416] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:48.867868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-25493697-3ba6-4f50-a438-7329e5643382 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.239929 Aug 24 16:09:48.874900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ddeea6a-37ee-4134-bb78-5635414aed4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'create', calling method: .version_select at 0x7fc5cd2c41f0>, body: {"keypair": {"name": "tempest-keypair-298517876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnXYwaBNlkQCjTkHcIBbrUX/Bs1u+MvyCo2KYCyUJ+3Ts0akHrTSWrQ1owNo5PTb/wV/5HJQMd1+Pm9674J74IA3HDNC00I7cYhPSbj2mZh+5FV7NXN3j9b7EW269oOxQ=="}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:09:48.875719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1728/3417] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:48.886860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-4ddeea6a-37ee-4134-bb78-5635414aed4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:09:48.890682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-4ddeea6a-37ee-4134-bb78-5635414aed4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for user c058b07c1e9e443ebacbf38b1f13e58b and project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:09:48.920965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ddeea6a-37ee-4134-bb78-5635414aed4d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056548 Aug 24 16:09:48.921581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1690/3418] 10.222.0.102 () {62 vars in 1205 bytes} [Wed Aug 24 16:09:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 16:09:49.369185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:49.369885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:49.376270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:49.376755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:49.377187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:49.378079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:49.378555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:49.378961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:49.514330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:49.524097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ad0e22a2-a1af-4746-892a-b1c6a33dec9e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158957 Aug 24 16:09:49.524697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1729/3419] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:49.887263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:49.887935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:49.893600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:49.893928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:49.894272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:49.894396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:49.894837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:49.895605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:49.896757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:49.897578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:49.901104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:49.901606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:49.902125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:49.902840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:49.903160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:49.903302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:49.903972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:50.107365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:50.112412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:50.116951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8626b838-459c-4ace-87a9-ec5e86c82542 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.233953 Aug 24 16:09:50.117671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1691/3420] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:50.122141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-25f628f5-7221-4b3b-ad7b-f7dfad8db64d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.235155 Aug 24 16:09:50.122719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1730/3421] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:50.226473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-813453029", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98cb2623-043e-451b-8b73-9ccca3fc016c"}], "security_groups": [{"name": "tempest-securitygroup--1418717660"}], "key_name": "tempest-keypair-298517876", "user_data": "}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:09:50.329016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] validate_networks() for [('98cb2623-043e-451b-8b73-9ccca3fc016c', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:09:50.546600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:50.547366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:50.554306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:50.554801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:50.555249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:50.555975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:50.556431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:50.557070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:50.831771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:50.842557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-904a7c87-1e87-4919-8875-a75da365f4f3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.299939 Aug 24 16:09:50.843676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1731/3422] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:50.892619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:09:50.893159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:09:50.893549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:09:50.893968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:09:50.894383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:09:50.904135 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:50.904618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:50.905062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:50.905842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:50.906287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:50.906714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:50.923662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:09:50.927677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Getting quotas for user c058b07c1e9e443ebacbf38b1f13e58b and project 0b5c7713b8574a09b7af9ab97b5ecbe1. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:09:50.938435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:09:50.940761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:09:50.988379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c141342b-b857-4eed-9d55-8f5937360e7e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.767253 Aug 24 16:09:50.988916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1692/3423] 10.222.0.102 () {62 vars in 1193 bytes} [Wed Aug 24 16:09:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 16:09:51.000069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0b697b9-4c29-45d4-bd34-f46e831bdd92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:51.000766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a0b697b9-4c29-45d4-bd34-f46e831bdd92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:51.054325 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b697b9-4c29-45d4-bd34-f46e831bdd92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:51.062210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b697b9-4c29-45d4-bd34-f46e831bdd92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:51.063357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0b697b9-4c29-45d4-bd34-f46e831bdd92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:51.064564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0b697b9-4c29-45d4-bd34-f46e831bdd92 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1284 microversion: 2.20 time: 0.068405 Aug 24 16:09:51.065127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1732/3424] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:50 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1284 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:51.139318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:51.139989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:51.148418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:51.148925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:51.149360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:51.150070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:51.150539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:51.151081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:51.154458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:51.155604 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:51.165181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:51.165929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:51.167016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:51.168146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:51.168847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:51.169475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:51.376122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:51.386756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a2e086e5-04f2-4c26-939c-be688aa4f2ee tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.250908 Aug 24 16:09:51.387436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1693/3425] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:51 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:51.390587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:51.402121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7782c23-03e4-42c5-a792-85e9eab722b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.261545 Aug 24 16:09:51.402867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1733/3426] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:51.863965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:51.864742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:51.870752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:51.871232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:51.871682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:51.872371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:51.872818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:51.873238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.010151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:52.018728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9e45eab-1f66-4e8f-8c3e-f4330d3342f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158565 Aug 24 16:09:52.019303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1694/3427] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:52.086971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:52.088454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:52.095468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:52.096296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:52.096926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.097989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:52.098873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:52.099619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.167529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:52.177205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:52.178858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:52.180064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-123cef8b-c382-4b57-ab22-7d3bf9b4b98d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1344 microversion: 2.20 time: 0.097063 Aug 24 16:09:52.195654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1734/3428] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:52 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:52.407709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:52.408331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:52.415343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:52.415870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:52.416311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.417007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:52.417469 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:52.417898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.425121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:52.425741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:52.433132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:52.433688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:52.434463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.435378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:52.435874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:52.436471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:52.634157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:52.643160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c868b966-c586-4182-821a-c3f69427c665 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.239288 Aug 24 16:09:52.656052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:52.656195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1695/3429] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:52.659495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c8296d46-850e-4e73-b6fa-f194e6fbc63b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.238495 Aug 24 16:09:52.660107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1735/3430] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:53.041259 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:53.041866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:53.048268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.048748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.049175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.049865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.050316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.050738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.199178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:53.203408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:53.204205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:53.208397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e034a5fd-520c-48db-9dc3-7c36a4e1df68 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.170986 Aug 24 16:09:53.208991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1696/3431] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:53.212608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.213395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.214779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.215809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.216499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.217196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.356361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:53.366341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:53.368024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:53.369265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b83fd063-7354-4810-ae71-da0bbbe8b4f6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1410 microversion: 2.20 time: 0.170170 Aug 24 16:09:53.369920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1736/3432] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:53 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1410 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:53.640215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-196ff926-0f74-4031-aa58-d708bb964250 req-82747ae2-c0ea-419e-bf9c-68e1e95221b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61cc3727-a031-4b16-befc-0397d485562d", "tag": "023a7f78-4c2f-4100-9fe5-283d259c51b9"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:09:53.650368 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-196ff926-0f74-4031-aa58-d708bb964250 req-82747ae2-c0ea-419e-bf9c-68e1e95221b8 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.650838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-196ff926-0f74-4031-aa58-d708bb964250 req-82747ae2-c0ea-419e-bf9c-68e1e95221b8 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.651271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-196ff926-0f74-4031-aa58-d708bb964250 req-82747ae2-c0ea-419e-bf9c-68e1e95221b8 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.663378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-196ff926-0f74-4031-aa58-d708bb964250 req-82747ae2-c0ea-419e-bf9c-68e1e95221b8 service nova] Creating event network-changed:023a7f78-4c2f-4100-9fe5-283d259c51b9 for instance 61cc3727-a031-4b16-befc-0397d485562d on hv-cinder-84932 Aug 24 16:09:53.667615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:53.669045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:53.670048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-196ff926-0f74-4031-aa58-d708bb964250 req-82747ae2-c0ea-419e-bf9c-68e1e95221b8 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094805 Aug 24 16:09:53.670659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1697/3433] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:09:53.675376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.675938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.676385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.677392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.678091 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.678679 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.685206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:53.685857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:53.692232 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.693155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.693468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.694194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:53.694633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:53.695061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:53.887263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:53.896339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:53.897324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-70f561e8-63e7-465e-9d95-1cae206cdd7d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.234954 Aug 24 16:09:53.904627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1737/3434] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:53.905276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a9376f86-b23f-4d9a-ac10-c540871d46ef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.226278 Aug 24 16:09:53.906061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1698/3435] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:54.232710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:54.233346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:54.240612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.241104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.241546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.242253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.242717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.243149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.378353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:54.386836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8b515741-cf7b-4c88-a9e4-7d2aee05fc59 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158213 Aug 24 16:09:54.387415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1738/3436] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:54.393968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:54.394699 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:54.401648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.402152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.402575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.403273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.403753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.404184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.532765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:54.541583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:54.543349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:54.544487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0ff63298-8969-4c71-9228-c94f71568e3e tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1410 microversion: 2.20 time: 0.154333 Aug 24 16:09:54.545047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1699/3437] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:54 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:54.919593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:54.920231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:54.926377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.927211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:54.927361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.927884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:54.928042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.928657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.929109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.929537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.934285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.934770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.935212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:54.935931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:54.936389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:54.936813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:55.136361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:55.139697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:55.145190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e424b5d2-2b6c-44c4-b821-fd6b887df375 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.229406 Aug 24 16:09:55.146638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1739/3438] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:55.149347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-602e818f-7c75-43b8-9b45-01f03df11611 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.225939 Aug 24 16:09:55.150002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1700/3439] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:55.408299 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:55.408857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:55.415784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:55.416281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:55.416760 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:55.417465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:55.418826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:55.418826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:55.557645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:55.561238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:55.566579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:55.567566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:55.567934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-26088552-5e69-4f2e-b1ad-66d60c64ba67 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.163255 Aug 24 16:09:55.570447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1740/3440] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:55.576550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:55.577254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:55.577754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:55.578722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:55.579349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:55.579826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:55.711461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:55.719726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:55.721230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:55.722344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7452df65-b364-449a-aa28-b1d2e71b9716 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1410 microversion: 2.20 time: 0.159884 Aug 24 16:09:55.722902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1701/3441] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:55 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1410 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:09:56.167035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:56.167803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:56.170305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:56.170927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:56.174351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.174920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.175369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.176123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.176974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.177537 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.179621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.180149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.180590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.181297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.181755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.182186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.390902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:56.398297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:56.400236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dcaef776-2fbd-49d0-9f80-5d80e5945b10 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.237320 Aug 24 16:09:56.400809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1741/3442] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:56.406858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c5229df-c24f-4927-a1f8-902228dacf7d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.240477 Aug 24 16:09:56.407504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1702/3443] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:56.592144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:56.592761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:56.595049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:56.600737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.601239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.601685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.602394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.602859 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.603302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.737617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:56.745083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:56.745698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:56.747094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ed9b72f-bf3b-41fd-a17b-9ef8286b045f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.158795 Aug 24 16:09:56.747703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1742/3444] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:56 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:56.752223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.752706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.753141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.753946 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:56.754413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:56.755611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:56.887661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:56.895899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:56.897403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:56.898559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dec4f61f-d39d-486b-96d7-ec74a6ad9721 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1410 microversion: 2.20 time: 0.157370 Aug 24 16:09:56.899117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1703/3445] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:56 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:57.421942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:57.422593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:57.428744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:57.429575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:57.429761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.430267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.430706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.431613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.431917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.432389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.437122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.437714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.438174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.438907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.439391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.439903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.628114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:57.636560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:57.638290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1f469843-b6ea-4681-80c7-806f1ec1bb92 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.220221 Aug 24 16:09:57.638879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1743/3446] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:57.644590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d74deb3-16fd-4455-a884-ab16ea8d414e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220593 Aug 24 16:09:57.645141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1704/3447] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:09:57.768886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:57.769499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:57.776184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.776680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.777120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.777823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.778284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.778714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.916539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:57.921233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:57.921999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:57.924343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:09:57.927015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-07da595e-ad30-49dd-b5f7-2471f2a25f55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.161673 Aug 24 16:09:57.928298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1744/3448] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:57.935861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.935861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.935861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:57.935861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:57.936277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:57.936277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.072895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:58.081303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:58.082819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:58.084161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-794fed69-7813-4335-a4e9-fda7b2856159 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1410 microversion: 2.20 time: 0.166662 Aug 24 16:09:58.084762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1705/3449] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:57 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:58.219773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-4ad18968-ebd5-4b93-b849-7f88453a9f43 req-5ecb3d27-cdde-4287-b70b-94409b633bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cc3727-a031-4b16-befc-0397d485562d", "name": "network-vif-plugged", "status": "completed", "tag": "023a7f78-4c2f-4100-9fe5-283d259c51b9"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:09:58.234188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-4ad18968-ebd5-4b93-b849-7f88453a9f43 req-5ecb3d27-cdde-4287-b70b-94409b633bd1 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.234671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-4ad18968-ebd5-4b93-b849-7f88453a9f43 req-5ecb3d27-cdde-4287-b70b-94409b633bd1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.235107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-4ad18968-ebd5-4b93-b849-7f88453a9f43 req-5ecb3d27-cdde-4287-b70b-94409b633bd1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.247199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-4ad18968-ebd5-4b93-b849-7f88453a9f43 req-5ecb3d27-cdde-4287-b70b-94409b633bd1 service nova] Creating event network-vif-plugged:023a7f78-4c2f-4100-9fe5-283d259c51b9 for instance 61cc3727-a031-4b16-befc-0397d485562d on hv-cinder-84932 Aug 24 16:09:58.253122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-4ad18968-ebd5-4b93-b849-7f88453a9f43 req-5ecb3d27-cdde-4287-b70b-94409b633bd1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099257 Aug 24 16:09:58.253697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1745/3450] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:09:58.660122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:58.660823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:58.667526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:58.668056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.668204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.668331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:58.668531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.669224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.669686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.670110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.674296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.674779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.675216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.675936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.676391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.676816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.864233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:58.868493 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:58.872895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-899c3b1f-8f78-42e6-a57f-b40c05bfbe6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.216550 Aug 24 16:09:58.873472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1706/3451] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:58 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:58.877057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6f06da7a-f9ab-489d-97b1-ea7ac052198d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.214730 Aug 24 16:09:58.877614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1746/3452] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:58.949779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:58.950422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:58.957248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.957738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.958176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:58.959371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:58.959859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:58.960286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:59.093325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:59.102620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1f16e7bf-0df9-4aa0-80db-92524cb11bee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156635 Aug 24 16:09:59.103230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1707/3453] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:09:59.106107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:59.106710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:59.112709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:59.113193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:59.113626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:59.114312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:59.114805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:59.115286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:59.251673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:59.260515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:59.262239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:09:59.263368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7e07e30a-dd42-4e08-80bd-8d82ef0e0a60 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1410 microversion: 2.20 time: 0.161076 Aug 24 16:09:59.263951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1747/3454] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:09:59 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:09:59.895774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:59.897200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:59.902311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:09:59.903183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:09:59.905540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:59.906150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:59.906580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:59.907275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:59.907750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:59.908174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:59.910620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:59.911845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:59.912754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:09:59.915116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:09:59.915601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:09:59.916079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.111346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:00.122781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dbd84f94-038c-452b-9642-dbf8734a30bb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.232105 Aug 24 16:10:00.123386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1708/3455] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:00.124087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:00.128482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:00.129106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:00.133402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c6aa26a2-f1f1-4663-877b-0905d21e4581 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.238194 Aug 24 16:10:00.134240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1748/3456] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:09:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:00.137439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:00.138096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:00.138545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.139265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:00.139772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:00.140206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.144644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:00.286814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:00.288154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:00.294903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:00.295414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:00.295921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.296650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:00.297122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:00.297722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.602938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:00.610020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:00.611434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e7e4ff0a-011e-496b-820e-e7c239cf1112 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.487022 Aug 24 16:10:00.612061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1709/3457] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:00.619682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:00.621198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:00.622360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ef2b4278-10e8-4e22-963e-966b3a5f70fb tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1602 microversion: 2.20 time: 0.339792 Aug 24 16:10:00.622923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1749/3458] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:10:00 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1602 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:10:00.644251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:00.644787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:00.651473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:00.652009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:00.652443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.653143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:00.653596 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:00.654023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:00.738755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bab4f6c5-59e9-40ab-abb2-be4ac1fd212d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098325 Aug 24 16:10:00.739349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1710/3459] 10.222.0.102 () {60 vars in 1321 bytes} [Wed Aug 24 16:10:00 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:10:01.144240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:01.144869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:01.147959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:01.152964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:01.153750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=10 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:01.156073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.156530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.156964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.157670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.158124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.158262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:01.158546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.158840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:01.167431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.167865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.168308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.169020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.169478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.169906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.371287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:01.374714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:01.381505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8deaeaca-996b-469d-8d41-63ff4d7a9088 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.240960 Aug 24 16:10:01.382255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1750/3460] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:01.384561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-901e4851-91b7-4413-b0af-35bf647b24ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.232195 Aug 24 16:10:01.385638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1711/3461] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:01 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:01.633998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:01.635238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:01.641356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.641846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.642317 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.643018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.643475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.643931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.725702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-f8230ef6-e3d1-4e09-a93c-a6b87812494e req-5dbccff1-efb6-4cac-8299-a9b600dd9221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61cc3727-a031-4b16-befc-0397d485562d", "tag": "023a7f78-4c2f-4100-9fe5-283d259c51b9"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:10:01.735160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-f8230ef6-e3d1-4e09-a93c-a6b87812494e req-5dbccff1-efb6-4cac-8299-a9b600dd9221 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:01.735656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-f8230ef6-e3d1-4e09-a93c-a6b87812494e req-5dbccff1-efb6-4cac-8299-a9b600dd9221 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:01.736103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-f8230ef6-e3d1-4e09-a93c-a6b87812494e req-5dbccff1-efb6-4cac-8299-a9b600dd9221 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:01.748209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-f8230ef6-e3d1-4e09-a93c-a6b87812494e req-5dbccff1-efb6-4cac-8299-a9b600dd9221 service nova] Creating event network-changed:023a7f78-4c2f-4100-9fe5-283d259c51b9 for instance 61cc3727-a031-4b16-befc-0397d485562d on hv-cinder-84932 Aug 24 16:10:01.753321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-f8230ef6-e3d1-4e09-a93c-a6b87812494e req-5dbccff1-efb6-4cac-8299-a9b600dd9221 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031280 Aug 24 16:10:01.754385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1712/3462] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:10:01.805811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:01.814759 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-42e12985-8f6d-44de-9078-ce430b0f4e57 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.185184 Aug 24 16:10:01.815677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1751/3463] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:01 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:02.404165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:02.405286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:02.406369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:02.407053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:02.412476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:02.413143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:02.413620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:02.414584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:02.415114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:02.415509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:02.415677 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:02.416135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:02.416636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:02.417411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:02.418045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:02.418671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:02.623071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:02.626748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:02.635690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3080a42b-9682-4a12-aca1-520da763b539 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.236271 Aug 24 16:10:02.635974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f80c3765-bb18-42ab-84e8-be60a3097e93 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.233243 Aug 24 16:10:02.636730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1713/3464] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:02.637453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1752/3465] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:02.838295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:02.838975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:02.845050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:02.845541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:02.845982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:02.846680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:02.847137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:02.847574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:02.989114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:02.997572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-40a20dac-ffae-4449-8372-48aa4f389c95 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.164055 Aug 24 16:10:02.998140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1714/3466] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:03.658207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:03.658779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:03.659163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:03.659296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:03.667011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:03.667218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:03.667494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:03.667648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:03.667962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:03.668105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:03.668652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:03.668767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:03.669106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:03.669236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:03.669524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:03.669640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:03.874648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:03.878500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:03.883290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f8c8f9bf-98db-49b8-a927-2d90ea441d3c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228635 Aug 24 16:10:03.883906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1715/3467] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:03.887192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7ee94b13-e0e3-40de-8727-47524cb15d93 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.232734 Aug 24 16:10:03.887949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1753/3468] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:03 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:04.018957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:04.019573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:04.026497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:04.026979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:04.027414 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:04.028132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:04.028600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:04.029008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:04.161461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:04.170751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ab9518e-3fb4-4dcf-a120-ba9df1530747 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155590 Aug 24 16:10:04.171508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1716/3469] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:04.905205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:04.905832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:04.909280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:04.910172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:04.912840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:04.913341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:04.913808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:04.914522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:04.914993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:04.915421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:04.917175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:04.917660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:04.918095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:04.918805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:04.919278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:04.919741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:05.117565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:05.121318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:05.125934 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5636d734-52b4-4b96-8542-a65e42851f22 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.224677 Aug 24 16:10:05.126506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1754/3470] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:05.129563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f84a716a-90d0-4d1b-8848-175d47dbbcc7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224027 Aug 24 16:10:05.130136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1717/3471] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:05.192250 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:05.192923 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:05.199017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:05.199506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:05.199978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:05.200668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:05.201126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:05.201554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:05.331429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:05.339771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fdc30a18-d390-45f4-bf13-0d289469d3e8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151380 Aug 24 16:10:05.340342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1755/3472] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:06.147066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:06.148222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:06.151038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:06.151682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:06.154941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:06.155427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:06.155893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:06.156595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:06.157049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:06.157482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:06.158249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:06.158739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:06.159184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:06.159921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:06.160384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:06.160818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:06.351516 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:06.362608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-84eff621-2818-4e21-a8ed-a89a78e5ecd4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219356 Aug 24 16:10:06.363193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1718/3473] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:06.368384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:06.368990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:06.375717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:06.383437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:06.384432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:06.385123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:06.386305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:06.386695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e5d007cd-59cb-4bfa-99c2-00091abdb35f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.240170 Aug 24 16:10:06.386939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:06.387702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1756/3474] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:06.387862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:06.525726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:06.533888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2ae617a5-5f5b-43db-9cb5-4f614a5997a5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.169631 Aug 24 16:10:06.534457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1719/3475] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:06 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:07.387157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:07.387812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:07.394321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:07.394809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:07.395254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:07.396560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:07.397042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:07.397572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:07.408157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:07.408772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:07.417810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:07.418640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:07.419350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:07.420600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:07.421353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:07.422096 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:07.604551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:07.611172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:07.612902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fe5e0790-305b-4307-ac4b-72eea05cace0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.229831 Aug 24 16:10:07.613658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1757/3476] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:07.619301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:07.619935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:07.620388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0fed045a-d3ad-491b-be6d-58c212a178fd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.216130 Aug 24 16:10:07.621264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1720/3477] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:07.631976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:07.632603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:07.633115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:07.633941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:07.634470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:07.634903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:07.639132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:07.776375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:07.784532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7aa1a07b-6300-415e-a048-6c331a227775 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.169933 Aug 24 16:10:07.785094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1758/3478] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:08.636155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:08.636952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:08.642301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:08.643017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:08.643590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:08.644118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:08.644562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:08.645457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:08.645920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:08.646354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:08.649849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:08.650348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:08.650787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:08.652176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:08.652637 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:08.653067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:08.854080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:08.857112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:08.862289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a61f37c0-2d57-44ea-9537-e07dbae0afa3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230673 Aug 24 16:10:08.862939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1721/3479] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:08.865667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f4963f09-74b3-4a94-8a52-22396e93ebfb tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.227280 Aug 24 16:10:08.866313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1759/3480] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:08.867605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:08.868235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:08.874408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:08.874893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:08.875338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:08.876077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:08.876533 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:08.877007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:09.008177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:09.016297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1521c993-5b7e-4773-b1ce-71f922caf52f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.152376 Aug 24 16:10:09.017057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1722/3481] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:09.884713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:09.885569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:09.886257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:09.886843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:09.893234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:09.893504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:09.893717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:09.894101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:09.894224 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:09.894707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:09.894840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:09.895273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:09.895697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:09.895825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:09.896318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:09.896801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:10.105412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:10.112286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:10.115914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-76297ce3-07ce-423b-b456-ff6e67a24145 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.233503 Aug 24 16:10:10.116508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1723/3482] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:10.120928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:10.121289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c254bc75-3ff1-4095-8f77-397aa5277764 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.241379 Aug 24 16:10:10.121538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:10.121864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1760/3483] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:10.127399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:10.127923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:10.128362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:10.129057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:10.129511 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:10.130137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:10.262998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:10.271122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e2598687-1e89-4342-b2f0-ec76ddc0b313 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153691 Aug 24 16:10:10.271709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1724/3484] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:11.138673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:11.139288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:11.142550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:11.143074 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:11.145774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:11.146245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:11.146677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:11.147373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:11.147955 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:11.148366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:11.149551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:11.150035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:11.150473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:11.151166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:11.151612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:11.152056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:11.348785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:11.352539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:11.358395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-83694652-e250-4cd3-a492-d3d27d49d85a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223598 Aug 24 16:10:11.359200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1761/3485] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:11.361301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c76073d1-a761-43e0-a2d1-dee2ca5a62e7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222968 Aug 24 16:10:11.364742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:11.365886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:11.369012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1725/3486] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:11.375190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:11.375712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:11.376159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:11.376874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:11.377335 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:11.377765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:11.524504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:11.532813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9c26cf8f-a882-47d7-8bd1-2881ad5dd398 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.172615 Aug 24 16:10:11.533385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1762/3487] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:11 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:12.381397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:12.382109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:12.382867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:12.383491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:12.389052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:12.389543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:12.389974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:12.390167 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:12.390660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:12.390794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:12.391095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:12.391214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:12.391718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:12.391919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:12.392318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:12.392742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:12.610234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:12.613766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:12.613963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:12.620312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7ca01e25-12e0-43b0-aa15-4cd98516cd83 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.243351 Aug 24 16:10:12.620894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1726/3488] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:12.623284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-77fd1156-df71-4b85-9f45-6fad8ef45777 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.244913 Aug 24 16:10:12.624122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1763/3489] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:12.625579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:12.626185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:12.632427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:12.632924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:12.633365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:12.634093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:12.634552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:12.634977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:12.763407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:12.771791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6bfb25bc-134a-423e-a581-5164807b2e46 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.149920 Aug 24 16:10:12.772423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1727/3490] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:13.642195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:13.642921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:13.644409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:13.645017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:13.649518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:13.650008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:13.650440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:13.651139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:13.651586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:13.651836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:13.652036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:13.652317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:13.652752 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:13.653444 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:13.653891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:13.654319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:13.845221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:13.851889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:13.855727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dff77487-8e26-4ca8-9fec-a487c1a1c037 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.214953 Aug 24 16:10:13.856318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1728/3491] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:13.860639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dc82dee9-b2e8-4538-809d-0e29b067ac6c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222272 Aug 24 16:10:13.860835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:13.861202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1764/3492] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:13.861346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:13.867871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:13.868601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:13.869052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:13.869757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:13.870219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:13.870650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:14.000575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:14.008597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-958e6164-2156-4f84-84ef-f3c9ef09d6a4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151349 Aug 24 16:10:14.009155 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1729/3493] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:14.876871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:14.877520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:14.882820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:14.883517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:14.884684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:14.885176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:14.885605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:14.886297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:14.886746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:14.887169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:14.889932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:14.890415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:14.890854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:14.891587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:14.892072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:14.892498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:15.081458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:15.089055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:15.090347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d6f085e-0784-4a21-a89f-fa0ad83e5de9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217274 Aug 24 16:10:15.091175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1765/3494] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:15.096783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:15.097594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:15.098129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-02ed3777-f2c6-457f-b6a1-37b770173d1f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.219608 Aug 24 16:10:15.098777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1730/3495] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:15.104213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:15.104704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:15.105145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:15.105846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:15.106304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:15.106731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:15.240548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:15.249189 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ce5beb0b-6d4e-486d-adcb-e2fc0373ebf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.156374 Aug 24 16:10:15.249754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1766/3496] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:16.111470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:16.112079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:16.118481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:16.118962 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:16.119388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:16.119820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:16.120280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:16.120446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:16.120610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:16.120944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:16.126833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:16.127330 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:16.127802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:16.128499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:16.128960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:16.129386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:16.315848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:16.320571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:16.325235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dba4e218-5aeb-460b-ae7b-fd7dedd3ba9c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217681 Aug 24 16:10:16.325832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1731/3497] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:16.329059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4dc1e553-d06a-4df7-bf3c-b4ffe95e99e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.213830 Aug 24 16:10:16.335826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1767/3498] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:16.336008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:16.336008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:16.338670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:16.339169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:16.339611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:16.340334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:16.340793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:16.341291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:16.476152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:16.484445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a40c1ddb-cd36-43a5-85c8-31c06ae7947f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157651 Aug 24 16:10:16.485148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1732/3499] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:16 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:17.346915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:17.347540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:17.350016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:17.351173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:17.355276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:17.355809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:17.356255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:17.356960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:17.357429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:17.357616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:17.357843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:17.358099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:17.358538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:17.359230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:17.359703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:17.360128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:17.557697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:17.561784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:17.565831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10efe750-ddbc-4d4f-90be-787b8b7fd28c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222768 Aug 24 16:10:17.566402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1768/3500] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:17.570855 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:17.571292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-796570ea-519f-4362-9b4e-3c84c7397dc2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.224979 Aug 24 16:10:17.571447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:17.572050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1733/3501] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:17.578235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:17.578513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:17.578940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:17.579641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:17.580114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:17.580534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:17.710970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:17.719367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9af14a08-1eab-4511-afa0-a4b4a37fa157 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.152017 Aug 24 16:10:17.719963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1769/3502] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:18.588689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:18.589420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:18.595354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:18.595985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:18.596188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:18.596558 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:18.596994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:18.597697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:18.598145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:18.598568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:18.602641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:18.603158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:18.604027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:18.604432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:18.604884 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:18.605424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:18.801807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:18.805109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:18.811588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b02cb8dd-f6bb-4f38-83aa-7884c9fceb0b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227447 Aug 24 16:10:18.812211 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1734/3503] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:18.813260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a596d2cd-58dc-436b-bae6-19ab5f8cd5b1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222199 Aug 24 16:10:18.813791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1770/3504] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:18.817416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:18.818244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:18.824686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:18.825172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:18.825611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:18.826327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:18.826966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:18.827396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:18.965999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:18.974109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6f44ab90-f896-4b68-b604-4f8bcc198673 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160964 Aug 24 16:10:18.974674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1735/3505] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:19.833150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:19.833755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:19.836119 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:19.836934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:19.840506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:19.840992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:19.841431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:19.842127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:19.842577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:19.843872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:19.843999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:19.843999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:19.844480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:19.845182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:19.845637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:19.846064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:20.047125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:20.050927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:20.055695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e7fb5961-e335-4581-970e-56b4994ab24e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.226538 Aug 24 16:10:20.056280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1771/3506] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:20.059979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6f08d3d6-8c83-4fa0-b181-5cce230a4c1e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.228470 Aug 24 16:10:20.060573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1736/3507] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:20.062257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:20.062873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:20.069024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:20.070108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:20.071265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:20.072020 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:20.072480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:20.072920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:20.207508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:20.217183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-77dc4a26-a575-4894-aa88-a516e48975ea tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159005 Aug 24 16:10:20.217754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1772/3508] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:21.077200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:21.078383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:21.083509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:21.084229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:21.086293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:21.086786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:21.087223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:21.087965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:21.088424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:21.088852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:21.091306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:21.091762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:21.092204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:21.092908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:21.093362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:21.093791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:21.283319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:21.286811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:21.292509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7d3c3ee5-21f1-4817-b2a7-58df03dc888d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219590 Aug 24 16:10:21.293183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1737/3509] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:21.296114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6fdc0895-db83-4965-b03a-9b1beaee0014 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.216745 Aug 24 16:10:21.296810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1773/3510] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:21.297781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:21.298408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:21.304255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:21.304672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:21.305452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:21.306146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:21.306601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:21.307028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:21.437579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:21.445897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f8462049-5729-4810-96be-13dff77eca7c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151540 Aug 24 16:10:21.446395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1738/3511] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:21 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:22.317316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:22.318013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:22.318391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:22.318519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:22.324576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:22.324811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:22.325066 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:22.325226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:22.325494 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:22.325639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:22.326183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:22.326332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:22.326630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:22.326789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:22.327049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:22.327217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:22.533908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:22.536355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:22.537427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:22.544324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d1229747-e665-4c74-bfd9-94bd23148b59 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.230817 Aug 24 16:10:22.544901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1774/3512] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:22.546536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c6673f28-02d8-4e42-9b2b-c225d4461423 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.232944 Aug 24 16:10:22.547406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1739/3513] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:22.549327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:22.549926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:22.556622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:22.557108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:22.557541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:22.558231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:22.558681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:22.559109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:22.688798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:22.698576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c6c6d8ae-f574-4dc7-823b-36f916d883e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.152641 Aug 24 16:10:22.699483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1775/3514] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:23.455917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:10:23.456893 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:10:23.566781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:23.567373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:23.568691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:23.569305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:23.574584 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:23.575161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:23.575536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:23.576275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:23.576391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:23.576721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:23.576845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:23.577217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:23.577328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:23.577912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:23.578367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:23.578791 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:23.775508 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:23.778502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:23.783807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f63a3995-3120-4b20-b59f-98608e9879d0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.221029 Aug 24 16:10:23.784685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1740/3515] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:23.786861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-075017ef-ecba-4706-a022-6a35c410fab2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221880 Aug 24 16:10:23.787569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1776/3516] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:23.789213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:23.790037 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:23.797912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:23.798416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:23.798852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:23.799597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:23.800113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:23.800738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:23.936168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:23.945205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fea90f12-cf95-4424-a522-ccd5eb01bd05 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159205 Aug 24 16:10:23.945961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1741/3517] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:24.809792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:24.810407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:24.810407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:24.810904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:24.816954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:24.817133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:24.817435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:24.817572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:24.817897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:24.818015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:24.818571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:24.818689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:24.819023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:24.819170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:24.819453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:24.819576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:25.019998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:25.023386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:25.028480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-aca52d36-34a7-4dbb-ae0b-331f9cd0820f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222595 Aug 24 16:10:25.029071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1742/3518] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:25.031976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a8e3c688-af07-493b-973b-0c1456840133 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.226038 Aug 24 16:10:25.032533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1777/3519] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:25.033776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:25.034394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:25.040507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:25.040998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:25.041553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:25.042267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:25.042724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:25.043151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:25.062480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:25.404978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:25.413256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d70409c0-cdf4-44b5-bd18-ead0de4269d4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.383250 Aug 24 16:10:25.413947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1743/3520] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:26.050521 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:26.051076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:26.053065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:26.053686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:26.059049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:26.059545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:26.060024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:26.060726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:26.060876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:26.061183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:26.061334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:26.061613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:26.061753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:26.062371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:26.062822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:26.063250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:26.257832 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:26.261587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:26.267212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1b8d2972-d79e-453d-b698-1fb8fbb54b7e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220690 Aug 24 16:10:26.268120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1778/3521] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:26 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:26.270019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ace75f08-9efe-4e0e-8608-77caa85b8213 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.220702 Aug 24 16:10:26.270587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1744/3522] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:26.435939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:26.436557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:26.442504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:26.443006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:26.443434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:26.444150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:26.444608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:26.445104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:26.578765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:26.587801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6c2c1f8e-6e41-45ed-b7e5-b5283b886b90 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155971 Aug 24 16:10:26.588367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1779/3523] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:26 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:27.289815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:27.290628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:27.290975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:27.291455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:27.294838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=76 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:27.297762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:27.298245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:27.298676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:27.299228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:27.299352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:27.299753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:27.299980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:27.300197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:27.300323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:27.300898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:27.301354 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:27.301781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:27.497500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:27.501620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:27.505737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f23abad4-5aac-44c4-9853-78b64f3da230 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220015 Aug 24 16:10:27.506312 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1745/3524] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:27.510177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0e13924c-c2d0-4fdf-9cd6-7c6519b04394 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.223225 Aug 24 16:10:27.510740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1780/3525] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:27.609550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:27.610078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:27.616113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:27.616598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:27.617038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:27.617736 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:27.618190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:27.619227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:27.753220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:27.761398 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-35a80bfc-f427-46f2-a4d7-2c17c4f6b7d1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155813 Aug 24 16:10:27.761959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1746/3526] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:28.527104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:28.527770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:28.533028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:28.533698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:28.534192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:28.534682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:28.535121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:28.535856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:28.536104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=84 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:28.536312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:28.537117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:28.542190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:28.542614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:28.543061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:28.543784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:28.544236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:28.544655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:28.734035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:28.738302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:28.742623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8b225286-36d0-48c3-8413-69fda4f2f372 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220090 Aug 24 16:10:28.743210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1781/3527] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:28.747060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-31c16f7a-7a69-466a-adb9-1c6814775289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218705 Aug 24 16:10:28.747622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1747/3528] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:28.782396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:28.783014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:28.789127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:28.789621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:28.790059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:28.791421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:28.791911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:28.792345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:28.929556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:28.937889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0cffa992-da96-4e68-b960-897a81811a13 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159315 Aug 24 16:10:28.938445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1782/3529] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:29.764056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:29.764735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:29.767836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:29.768452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:29.772197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:29.772684 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:29.773124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:29.773832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:29.774289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:29.778380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:29.778548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:29.778548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:29.778548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:29.778548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:29.778999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:29.778999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:29.978999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:29.986457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:29.987547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-42ea64ff-162c-4dfc-a04e-86cff6c8c835 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227580 Aug 24 16:10:29.988165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1748/3530] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:29.995253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6d9c6e36-d71c-47f9-838f-56df2583f6e3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.231158 Aug 24 16:10:29.996052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1783/3531] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:29.996547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:29.997484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:30.003402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:30.004010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:30.004378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:30.005079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:30.005538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:30.005969 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:30.135823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:30.144012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fe89714e-f3e0-407f-a6a1-380be46624c4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151833 Aug 24 16:10:30.144578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1749/3532] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:31.008812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:31.009603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:31.016356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:31.016586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:31.017034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:31.017154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:31.017278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:31.017960 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:31.018426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:31.018858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:31.023738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:31.024227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:31.025145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:31.025882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:31.026319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:31.026740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:31.226367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:31.230047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:31.234816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f93da03b-8894-4401-accc-fa237319f76a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230704 Aug 24 16:10:31.235390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1784/3533] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:31.238633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8712b6cd-ec64-4904-96da-906ec4647030 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.225860 Aug 24 16:10:31.239461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1750/3534] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:31.239864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:31.240471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:31.246411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:31.246900 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:31.247337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:31.248057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:31.248529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:31.248936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:31.382929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:31.391663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f8a2c2ec-95bb-4625-a585-6cf5fe6ee232 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155217 Aug 24 16:10:31.392195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1785/3535] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:31 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:32.256011 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:32.256739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:32.259946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:32.260592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:32.264303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:32.264797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:32.265244 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:32.265949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:32.266406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:32.266868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:32.266988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:32.267413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:32.267892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:32.268596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:32.269054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:32.269713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:32.465907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:32.468752 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:32.474517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91606b69-79cd-4091-8a99-4c860d8d9805 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222451 Aug 24 16:10:32.475093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1751/3536] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:32.477390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dd6ab60f-6d59-4576-a538-1b391e8d9bd2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.221459 Aug 24 16:10:32.478874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1786/3537] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:32.481029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:32.481658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:32.488147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:32.488826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:32.489269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:32.490006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:32.490494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:32.490921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:32.626009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:32.634038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6e4dd88f-8962-4adb-8b66-e07ca516f857 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157998 Aug 24 16:10:32.634770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1752/3538] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:33.498797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:33.499421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:33.499770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:33.500381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:33.507094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:33.507586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:33.507761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:33.508057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:33.508470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:33.508780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:33.509142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:33.509868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:33.510067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:33.510187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:33.510589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:33.511013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:33.705435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:33.708850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:33.714864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0bf7f328-07b2-4cda-a88a-7d9f4df26f39 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222291 Aug 24 16:10:33.715440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1787/3539] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:33.717214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-56108e70-dd0c-4675-a106-b0c73d916408 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.221202 Aug 24 16:10:33.717930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1753/3540] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:33.721866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:33.722473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:33.729228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:33.729714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:33.730146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:33.730841 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:33.731306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:33.731736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:33.868346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:33.876610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dfe29719-bbd3-4ed8-8418-6a5d71a4fd75 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160172 Aug 24 16:10:33.877181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1788/3541] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:34.736839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:34.737405 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:34.738247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:34.738874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:34.744376 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:34.744869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:34.745316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:34.746023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:34.746234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:34.746484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:34.746728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:34.746913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:34.747173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:34.747978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:34.748448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:34.748876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:34.942680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:34.946042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:34.952627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-21c2715a-ddd6-4cd1-8b8c-f1a475200380 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218355 Aug 24 16:10:34.953212 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1789/3542] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:34.955339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-42585c72-f014-4439-99b4-3c478e78e011 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222269 Aug 24 16:10:34.955934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1754/3543] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:34.957904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:34.958515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:34.965774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:34.966272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:34.966717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:34.967556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:34.968055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:34.968496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:35.100705 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:35.109114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-94fe86eb-95a7-4158-87e7-e1b67d6dd170 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.154937 Aug 24 16:10:35.109682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1790/3544] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:35.978466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:35.979055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:35.980650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:35.981295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:35.985639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:35.986118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:35.986546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:35.987242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:35.987725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:35.988038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:35.988182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:35.989162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:35.989162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:35.989852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:35.990309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:35.990733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:36.010254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:36.178201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:36.182161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:36.186764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7555dd7c-3a5f-44e2-a703-85a0ada47c88 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.212882 Aug 24 16:10:36.187349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1755/3545] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:36.191856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:36.192532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:36.195050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6fa4a034-e455-4bf4-9789-c2645f5a94f6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218663 Aug 24 16:10:36.195792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1791/3546] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:35 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:36.198926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:36.199413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:36.199883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:36.200581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:36.201033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:36.201458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:36.338023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:36.345795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7b4da8f0-294e-45f9-897d-317e9548b288 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.157477 Aug 24 16:10:36.346359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1756/3547] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:36 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:37.210156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:37.210851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:37.216602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:37.217262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:37.217682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.218165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.218606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.219319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.219812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.220239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.223606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.224120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.224560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.225258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.225714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.226280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.424746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:37.432305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:37.433870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-eca3539f-18d3-4bb8-a43e-ca5a633d90d0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.229339 Aug 24 16:10:37.434460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1792/3548] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:37.439014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:37.439621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:37.440724 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8658f623-e993-4473-84fc-67ed8f2a7aa2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.228505 Aug 24 16:10:37.451654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1757/3549] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:37.451919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.451919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.451919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.451919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.452336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.452336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.588525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:37.596755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cc209be7-5fc0-4ecc-88b0-7691aadb842b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.161350 Aug 24 16:10:37.597311 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1793/3550] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:37.931613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:37.932191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:37.938269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.938816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.939301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.940384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:37.941195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:37.941658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:37.966393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb10b3f1-5bc2-4a2d-bea1-bf0074efd8a5 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d/ips" status: 200 len: 152 microversion: 2.20 time: 0.039019 Aug 24 16:10:37.966967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1758/3551] 10.222.0.102 () {60 vars in 1294 bytes} [Wed Aug 24 16:10:37 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:10:38.455215 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:38.457581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:38.462744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:38.463460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:38.463761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:38.463961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:38.464184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:38.464887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:38.465341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:38.465773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:38.471420 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:38.472033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:38.472377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:38.473075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:38.473522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:38.473942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:38.663390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:38.667675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:38.672080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-561e5a97-ea1f-405c-89d9-d8a8d05c1d1d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220570 Aug 24 16:10:38.672659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1794/3552] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:38.675769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1130127f-c33b-4e70-8160-1385933103c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.216990 Aug 24 16:10:38.676552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1759/3553] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:38.677095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:38.678123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:38.683816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:38.684302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:38.684737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:38.685428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:38.686168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:38.686663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:38.825327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:38.834336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-efbc8766-6d0b-4d6a-9614-8e6aebfe02f7 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.160678 Aug 24 16:10:38.834912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1795/3554] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:39.694033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:39.694657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:39.696581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:39.697247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:39.702604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:39.703134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:39.703587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:39.704334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:39.704650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:39.704774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:39.705151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:39.705271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:39.705591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:39.706304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:39.707019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:39.707449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:39.726728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:39.915844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:39.919106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:39.927505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-77d651ba-860a-4d1d-aaf8-915acfc7d100 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.234722 Aug 24 16:10:39.928122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1796/3555] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:39.933181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-90c155f5-253f-4270-9f77-a4e38bb08a75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.239231 Aug 24 16:10:39.933181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1760/3556] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:39.933428 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:39.933755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:39.939994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:39.940484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:39.940925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:39.941626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:39.942083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:39.942513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:40.073872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:40.082262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5fe4ca75-667c-4c37-9786-23608876aebf tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.153117 Aug 24 16:10:40.082834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1797/3557] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:40.950513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:40.951165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:40.951551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:40.951695 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:40.957798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:40.958077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:40.958263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:40.958567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:40.958688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:40.959008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:40.959379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:40.959738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:40.959867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:40.960306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:40.960430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:40.960635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:41.156631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:41.159125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:41.165195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-37528964-571a-41a7-b769-9eca44543f1b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218927 Aug 24 16:10:41.165768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1798/3558] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:41.167984 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-95f3916a-9039-4c8b-8a58-065e3c365798 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222044 Aug 24 16:10:41.168541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1761/3559] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:40 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:41.170911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:41.171523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:41.177549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:41.178237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:41.178676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:41.179368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:41.179858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:41.180286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:41.310052 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:41.318204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6a5c9645-8641-48a6-b6a9-d52a5019dc55 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.150944 Aug 24 16:10:41.318764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1799/3560] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:41 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:42.188085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:42.188989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:42.189574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:42.190495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:42.194973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:42.195458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:42.195932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:42.196630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:42.197083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:42.198203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:42.198848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:42.199433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:42.199948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:42.200698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:42.201216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:42.201740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:42.403959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:42.407213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:42.412427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-71c656e4-b9e2-4ec9-8254-acd880758622 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228435 Aug 24 16:10:42.413002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1762/3561] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:42.415481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bad8a783-23c0-4c2a-b87f-1c52b0524201 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.230242 Aug 24 16:10:42.416236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1800/3562] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:42.417710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:42.418321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:42.424255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:42.424740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:42.425177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:42.425865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:42.426330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:42.426751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:42.568053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:42.577600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ede74703-cf9a-4a15-bf3c-e2f4cbcdc7de tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.163379 Aug 24 16:10:42.578184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1763/3563] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:43.437847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:43.438446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:43.439146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:43.439826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:43.444732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:43.445240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:43.445668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:43.446194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:43.446368 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:43.446679 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:43.446809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:43.447114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:43.447235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:43.447998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:43.448453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:43.448880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:43.647961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:43.656165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:43.656998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e97ea32-9d24-47bf-95ee-3520b981e293 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.222988 Aug 24 16:10:43.657577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1801/3564] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:43.661996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:43.662602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:43.665066 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-39519504-8d95-456f-9706-e8683381d10f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.229674 Aug 24 16:10:43.665821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1764/3565] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:43.669407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:43.669904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:43.670341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:43.671246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:43.671906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:43.672341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:43.805329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:43.813702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-379f5f32-cda9-4e0a-a418-438c1955b30f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.155173 Aug 24 16:10:43.814275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1802/3566] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:44.679671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:44.680292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:44.686729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:44.687487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:44.687624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:44.688086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:44.688528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:44.689230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:44.689686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:44.690109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:44.694095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:44.694577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:44.695011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:44.695793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:44.696253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:44.696674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:44.898719 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:44.907288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-22a0ee56-88cd-4a59-9a5b-1aae3631caef tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.231491 Aug 24 16:10:44.907444 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:44.907895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1765/3567] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:44.912759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:44.913429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:44.918956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1725b0a1-19dc-4dc7-911a-e9d254f50de2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.235806 Aug 24 16:10:44.928129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:44.928129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:44.928129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:44.928129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:44.928644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:44.928644 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:44.929055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1803/3568] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:45.072601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:45.081905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4410d81e-b27a-4a87-a476-704f6c1f63f6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.172723 Aug 24 16:10:45.082467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1766/3569] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:45.929669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:45.930287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:45.937985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:45.938477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:45.938918 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:45.939618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:45.940103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:45.940538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:45.942168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:45.942812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:45.949980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:45.950482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:45.950906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:45.951606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:45.952082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:45.952544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:46.130755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:46.140232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-35bc95a2-fcab-4e28-a112-c2bce5e82866 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.214267 Aug 24 16:10:46.151781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1804/3570] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:45 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:46.152015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:46.152149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:46.152149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:46.152333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-03a39556-da88-4929-8b1a-348d62279366 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.212440 Aug 24 16:10:46.152333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1767/3571] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:46.152502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:46.152602 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:46.152991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:46.153733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:46.154199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:46.154628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:46.293376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:46.301515 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d11be86-40ef-4235-ba9b-0e684bcf5875 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.159728 Aug 24 16:10:46.302071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1805/3572] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:46 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:47.168454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:47.169060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:47.172289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:47.172907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:47.175580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:47.176095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:47.176527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:47.177218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:47.177669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:47.178089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:47.179504 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:47.180027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:47.180470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:47.181165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:47.181786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:47.182216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:47.374674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:47.379105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:47.383251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eace05c1-2033-40a4-99cc-945507424dc5 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.218677 Aug 24 16:10:47.383855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1768/3573] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:47.388601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7155a3a7-e865-48d0-a907-48597d0440a1 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220192 Aug 24 16:10:47.389160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1806/3574] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:47.389426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:47.390064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:47.396052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:47.396534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:47.396973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:47.397665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:47.398117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:47.398540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:47.528403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:47.536441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-148909bb-ce07-4e1a-96c0-88543fbf9b3d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151657 Aug 24 16:10:47.537004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1769/3575] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:48.406104 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:48.406708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:48.409130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:48.409749 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:48.414687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:48.415149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:48.415598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:48.416869 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:48.418973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:48.419113 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:48.419245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:48.419357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:48.419747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:48.420461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:48.420875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:48.421975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:48.627607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:48.631656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:48.636088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3158320b-8672-4aca-984a-6ee7d0e4abcd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.234273 Aug 24 16:10:48.637315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1807/3576] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:48.640979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-87c51627-f5e7-4d4e-8268-5337937dddeb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.235626 Aug 24 16:10:48.641808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:48.642639 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:48.648552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:48.649045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:48.649484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:48.650190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:48.650654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:48.651083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:48.651906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1770/3577] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:48.656291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:48.781638 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:48.789937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-85267ce3-2673-48f4-b4e2-97ac01a33ae9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.151662 Aug 24 16:10:48.791137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1808/3578] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:49.658472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:49.659081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:49.666621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:49.667107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:49.667589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:49.668352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:49.668791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:49.669218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:49.749333 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:49.749956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:49.756259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:49.756757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:49.757204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:49.757915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:49.758402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:49.759156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:49.815934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:49.825366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-27025589-b8de-4a09-89b1-1db6a1299289 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.169631 Aug 24 16:10:49.829964 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1771/3579] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:49.835493 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:49.836133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:49.842185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:49.842902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:49.843332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:49.844555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:49.844555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:49.844923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:49.939671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:49.948036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-191bd63d-0701-4720-b1fd-29c05e787042 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.289646 Aug 24 16:10:49.948876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1809/3580] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:49.996641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:50.004894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fc375183-4962-4eb2-ac8f-792d02cfcf45 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.173525 Aug 24 16:10:50.005458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1772/3581] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:50.848707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:50.849329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:50.856615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:50.857110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:50.857549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:50.858243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:50.858701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:50.859130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:50.974764 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:50.975945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:50.987036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:50.987942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:50.988723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:50.989855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:50.990683 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:50.991452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:51.002708 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:51.011711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-238f85f0-004b-46f3-8cb8-4baad0d95a34 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.166424 Aug 24 16:10:51.012351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1810/3582] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:50 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:51.029578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:51.030183 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:51.036617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:51.037100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:51.037530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:51.038225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:51.038678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:51.039100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:51.182260 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:51.191331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5cb41b43-ed11-4f11-a564-a46350e2d383 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223794 Aug 24 16:10:51.192042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1773/3583] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:50 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:51.212777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:51.221868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e22d6e79-a30b-4c3f-9c0b-ed1864d50c7b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.196699 Aug 24 16:10:51.222438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1811/3584] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:51 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:52.033793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:52.034355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:52.040723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:52.041205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:52.041641 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:52.042330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:52.043428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:52.043900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:52.172078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:52.180123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d88f1c7b-9556-46cf-b9e8-b0747ae7f7dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.150259 Aug 24 16:10:52.180680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1774/3585] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:52 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:52.213315 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:52.213930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:52.221732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:52.222221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:52.222661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:52.223353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:52.223845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:52.224279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:52.242249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:52.242866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:52.249098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:52.249588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:52.250022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:52.250718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:52.251178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:52.251604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:52.411458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:52.421266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c702c639-0974-45ed-9763-d7e85dea3596 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.211797 Aug 24 16:10:52.422077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1812/3586] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:52.433681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:52.441793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-869a802c-5902-4eab-b3b1-f333d5698bc3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.203417 Aug 24 16:10:52.442343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1775/3587] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:52 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:53.201481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:53.202096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:53.208388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:53.208871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:53.209305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:53.209991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:53.210456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:53.210928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:53.354620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:53.363381 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-aa37f827-49e3-4c0a-b0c6-e7e6b9cc14d2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.165883 Aug 24 16:10:53.363987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1813/3588] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:53 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:53.442570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:53.443193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:53.450188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:53.450672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:53.451110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:53.451876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:53.452282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:53.452706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:53.464201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:53.465616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:53.471781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:53.472192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:53.472624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:53.473320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:53.473765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:53.474291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:53.650873 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:53.658487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:53.659859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bc0a1b1c-2efc-409f-a3ec-08e806605c84 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221104 Aug 24 16:10:53.660439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1776/3589] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:53.666954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b21a6dba-06d6-4f6f-be18-0d1bd7a83cd1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.206611 Aug 24 16:10:53.667584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1814/3590] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:53 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:54.384654 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:54.385267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:54.391993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:54.392524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:54.392965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:54.393655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:54.394141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:54.394570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:54.398477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:54.525712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:54.537982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0db2183c-6e45-4ffb-abdb-ec6ef3a2cab6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157084 Aug 24 16:10:54.538572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1777/3591] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:54 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:54.682295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:54.682899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:54.688510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:54.689123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:54.690593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:54.691084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:54.691524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:54.692254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:54.692710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:54.693141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:54.695403 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:54.695919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:54.696361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:54.697061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:54.697519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:54.697945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:54.890946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:54.894965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:54.899606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10e44e37-25a9-44c9-8c5c-dc9efad8b929 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221216 Aug 24 16:10:54.900213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1815/3592] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:54.904433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9a86b5cf-35ee-4551-8a4e-4f6c587adc5e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219678 Aug 24 16:10:54.905007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1778/3593] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:54 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:55.560618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:55.561138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:55.567073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:55.567590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:55.568064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:55.568769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:55.569227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:55.569657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:55.702198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:55.710673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-41a9a2fd-bdee-46d0-9f44-ac2c9ea124a6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154554 Aug 24 16:10:55.711240 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1816/3594] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:55 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:55.922479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:55.923094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:55.928765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:55.929523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:55.929735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:55.930225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:55.930665 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:55.931395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:55.931879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:55.932310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:55.935983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:55.936479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:55.936917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:55.937621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:55.938072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:55.938506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:56.134360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:56.138366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:56.143598 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3552c064-eef0-4715-ab5f-0aae1360c5b3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.225130 Aug 24 16:10:56.144209 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1779/3595] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:55 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:56.146654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-828fa149-c1d0-429b-bd95-1359fbf5c31f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223743 Aug 24 16:10:56.147219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1817/3596] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:55 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:56.732703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:56.733343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:56.739383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:56.739896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:56.740331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:56.741023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:56.741474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:56.741898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:56.875704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:56.883970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ec330f70-fcce-4236-b80a-be9d1d43be4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155828 Aug 24 16:10:56.884530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1780/3597] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:56 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:57.164596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:57.165244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:57.167843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:57.168572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:57.172684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:57.173217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:57.173621 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:57.174353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:57.174801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:57.174931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:57.175225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:57.175360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:57.175826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:57.176527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:57.176979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:57.177404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:57.371221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:57.374619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:57.379501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d2ad251c-6d03-4a1c-8530-3a03d0638df8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218744 Aug 24 16:10:57.380098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1818/3598] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:57.383230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d138c2d-319f-4ed0-a8d8-398b1bd41766 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219229 Aug 24 16:10:57.383967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1781/3599] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:57 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:57.906656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:57.907232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:57.909126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=78 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:57.914214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:57.914699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:57.915128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:57.915862 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:57.916313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:57.916737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:58.289259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:58.297620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c9d5d79b-1bef-47b3-85c2-0185a891b440 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.394799 Aug 24 16:10:58.298192 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1819/3600] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:57 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:58.401574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:58.402822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:58.404775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:58.405387 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:58.409284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:58.409878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:58.410202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:58.410899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:58.411350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:58.411478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:58.411801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:58.411940 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:58.412382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:58.413077 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:58.413535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:58.413962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:58.608712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:58.611789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:58.617574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d7cbe7f9-af7b-4926-8734-74298526848b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219882 Aug 24 16:10:58.618153 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1782/3601] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:58.619969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5fabfef8-115a-4e75-be31-723542b1965b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219453 Aug 24 16:10:58.621155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1820/3602] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:58 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:59.319597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:59.320294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:59.322134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=72 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:10:59.328310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:59.328799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:59.329241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:59.329943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:59.330433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:59.330864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:59.461360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:59.469805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a6663a22-f6f1-44c3-ad1e-a0919b8ee95a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154107 Aug 24 16:10:59.470382 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1783/3603] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:59 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:10:59.640499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:59.641120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:59.642371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:10:59.642992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:10:59.647907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:59.648396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:59.648828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:59.648972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:59.649445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:59.649586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:59.649884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:59.650016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:59.650376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:59.650586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:10:59.651043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:10:59.651472 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:10:59.858109 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:59.862249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:10:59.866769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-00837e78-2c0a-4e29-87da-5e0baa0728fb tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.230875 Aug 24 16:10:59.867361 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1821/3604] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:10:59.870864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b81d505-72f6-4506-a847-b9f97b0fff04 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.232213 Aug 24 16:10:59.871672 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1784/3605] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:10:59 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:00.547492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:00.548128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:00.554164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:00.554651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:00.555084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:00.555810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:00.556266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:00.556689 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:00.696402 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:00.705440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-190ec8ca-de6b-407a-9549-4eec587ebeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.161843 Aug 24 16:11:00.706025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1822/3606] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:00 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:00.889951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:00.890670 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:00.891929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:00.892553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:00.897250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:00.897743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:00.898184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:00.898596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:00.898893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:00.899082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:00.899356 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:00.899546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:00.899813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:00.900247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:00.900740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:00.901163 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:01.100467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:01.103292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:01.109362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dbe0fc52-a650-44a8-a5f1-1084eab832a6 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221529 Aug 24 16:11:01.109951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1823/3607] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:00 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:01.112287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8dda85b5-8adf-4432-a196-c8981ef5df07 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.227165 Aug 24 16:11:01.112849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1785/3608] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:01.727373 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:01.728019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:01.735920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:01.736408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:01.736849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:01.737548 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:01.738008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:01.738437 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:01.874642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:01.878118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:01.883756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-021b3114-4ad6-4742-aaae-b375bec3819c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.160217 Aug 24 16:11:01.884328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1824/3609] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:01 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:02.131417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:02.132059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:02.134205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:02.134846 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:02.139104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:02.139586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:02.140049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:02.140750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:02.141193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:02.141621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:02.141827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:02.142327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:02.142764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:02.143467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:02.143959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:02.144391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:02.328702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:02.337339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6396650b-e82b-4220-9ae6-410d15d8bff2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.209654 Aug 24 16:11:02.338012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1786/3610] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:02 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:02.340989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:02.349576 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-271ef92d-f3b2-4b59-ab38-e3d8c8fee82d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219319 Aug 24 16:11:02.350248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1825/3611] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:02.905474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:02.906093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:02.912047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:02.912539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:02.912986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:02.913689 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:02.914147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:02.914581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:03.049667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:03.058858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb0fe970-2320-4dea-983f-b24265be49ed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157213 Aug 24 16:11:03.059435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1787/3612] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:02 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:03.359005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:03.359642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:03.366136 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:03.366696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:03.367128 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:03.367852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:03.368312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:03.368739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:03.371150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:03.371841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:03.378174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:03.378668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:03.379284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:03.380024 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:03.380483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:03.380913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:03.568642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:03.572963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:03.578343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bfa37b85-df91-47c2-bc2b-f3840576b59a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223827 Aug 24 16:11:03.578927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1826/3613] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:03 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:03.582692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1d421695-1cff-489d-a746-6e9fa43a8860 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215881 Aug 24 16:11:03.583364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1788/3614] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:04.080406 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:04.080936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:04.087114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:04.087594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:04.088058 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:04.088744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:04.089303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:04.089844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:04.220297 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:04.228469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1ee41649-1d1d-46f5-8458-3591083394dd tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.151986 Aug 24 16:11:04.229047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1827/3615] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:04 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:04.601144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:04.601766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:04.604377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:04.605718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:04.609544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:04.610041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:04.610482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:04.611192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:04.611667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:04.612111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:04.612282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:04.612781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:04.613210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:04.613925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:04.614384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:04.614783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:04.805296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:04.812231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:04.813790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-964cb9f6-78a4-4d4a-84f7-9a78bde4719c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.217309 Aug 24 16:11:04.814375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1789/3616] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:04 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:04.820645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb9af4f8-36b3-412e-bb63-95454f3a27dc tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220199 Aug 24 16:11:04.821363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1828/3617] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:05.250314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:05.250920 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:05.256896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:05.257373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:05.257852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:05.258534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:05.258981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:05.259396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:05.390606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:05.398858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-63cf3057-c488-4dc4-8133-cf5c699b9941 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152383 Aug 24 16:11:05.399421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1790/3618] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:05 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:05.834505 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:05.835121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:05.842056 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:05.842436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:05.842898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:05.843020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:05.843119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:05.843764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:05.844231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:05.844662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:05.849076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:05.849560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:05.849997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:05.850690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:05.851137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:05.851561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:06.037849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:06.045381 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:06.046721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-cab1e35f-d21f-415b-b1f8-d3d303bd10cb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216275 Aug 24 16:11:06.047313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1829/3619] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:05 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:06.053721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d7ab3ad3-1408-4abd-8e36-6b3bc00b48e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215708 Aug 24 16:11:06.054366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1791/3620] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:06.421508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:06.422123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:06.428308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:06.428787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:06.429217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:06.429903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:06.430345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:06.430763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:06.575233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:06.585456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3c5f5fc6-e5c1-4b8a-baa9-de852cb6f456 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.169179 Aug 24 16:11:06.586078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1830/3621] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:06 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:07.069200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:07.069811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:07.077581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:07.078032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:07.078485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:07.078485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:07.078721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:07.079173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:07.079624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:07.080132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:07.085391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:07.085878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:07.086316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:07.087009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:07.087465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:07.087925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:07.316026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:07.318846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:07.324836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b43b71d6-5bec-4e7b-ab2a-b1e7f30c7162 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.252898 Aug 24 16:11:07.325424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1831/3622] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:07.327171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fce43614-ae6e-4067-b723-36528806a1a8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.261792 Aug 24 16:11:07.327753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1792/3623] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:07 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:07.608566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:07.609351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:07.617191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:07.617876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:07.618495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:07.619483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:07.620277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:07.620798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:07.756930 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:07.765466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0cc88e40-972e-4ea8-9c3b-25fffcac815c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.162896 Aug 24 16:11:07.766037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1832/3624] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:07 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:08.347322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:08.348874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:08.349501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:08.350363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:08.358546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:08.359095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:08.359485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:08.359773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:08.360207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:08.360821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:08.361078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:08.361824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:08.361953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:08.362477 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:08.362684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:08.363092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:08.566151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:08.569344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:08.572756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:08.577691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7116470b-bbcd-4a28-a087-ed5bb9b32514 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230370 Aug 24 16:11:08.578282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1833/3625] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:08 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:08.579347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b080ba1b-90e7-47c2-a010-f7d072f9c786 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.236622 Aug 24 16:11:08.579945 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1793/3626] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:08 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:08.786514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:08.787048 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:08.793116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:08.793614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:08.794036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:08.794728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:08.795184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:08.795610 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:08.925853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:08.934664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3b69c508-6066-495b-ad69-c1a316580249 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152073 Aug 24 16:11:08.935231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1834/3627] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:08 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:09.598567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:09.599223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:09.601190 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:09.601804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:09.606628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:09.607126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:09.607567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:09.608498 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:09.608813 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:09.608954 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:09.609307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:09.609425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:09.609747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:09.610447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:09.610905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:09.611331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:09.820310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:09.825607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:09.829725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e4f8d853-fa8f-4a92-9a68-12f488cf8ede tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.235240 Aug 24 16:11:09.830315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1794/3628] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:09 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:09.834219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-af66aa05-812b-48bd-bf76-a980d98e88de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.236725 Aug 24 16:11:09.834929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1835/3629] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:09.955820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:09.956463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:09.962604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:09.963086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:09.963529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:09.964756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:09.965210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:09.965635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:10.096084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:10.104257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f2f1c677-6c1c-45e4-a0ca-50874f4f0763 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152358 Aug 24 16:11:10.105574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1795/3630] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:09 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:10.851739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:10.852359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:10.855526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:10.856159 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:10.859726 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:10.860219 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:10.860660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:10.861363 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:10.861826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:10.862345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:10.862475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:10.862874 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:10.863303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:10.864010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:10.864455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:10.864913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:11.059426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:11.066460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:11.067757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6fd0828a-adaf-40a1-b7e2-9180d27b31b9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215970 Aug 24 16:11:11.068539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1796/3631] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:11.075937 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e2afa76-8066-4c81-9e84-1590d45760ae tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.228002 Aug 24 16:11:11.076498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1836/3632] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:10 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:11.125743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:11.126287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:11.132192 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:11.132685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:11.133122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:11.133815 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:11.134270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:11.134698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:11.267163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:11.275355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1dcb501c-12c1-48f8-81fa-cd924aedb9df tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.153522 Aug 24 16:11:11.275957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1797/3633] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:11 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:12.089530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:12.090139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:12.097036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:12.097528 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:12.097962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:12.098661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:12.099120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:12.099546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:12.100560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:12.101171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:12.108246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:12.108727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:12.109161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:12.109854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:12.110301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:12.110718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:12.299431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:12.303392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:12.308651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e6f61a16-5dfa-44a3-a0a4-68fd4a037b3b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222758 Aug 24 16:11:12.319837 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1837/3634] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:12.320063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0e6584f4-b78b-413d-a7a1-0bd54bedc1b5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.214892 Aug 24 16:11:12.320063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1798/3635] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:12 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:12.320291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:12.320291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:12.320879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:12.321424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:12.321864 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:12.322559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:12.323016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:12.323445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:12.465954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:12.474057 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b3ef549-8bd0-4dcb-af65-9c777c6a2c44 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.163667 Aug 24 16:11:12.474620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1838/3636] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:12 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:13.330421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:13.331057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:13.333438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:13.334459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:13.339460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:13.340685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:13.341147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:13.341879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:13.342342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:13.342771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:13.342952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:13.343419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:13.343943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:13.344652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:13.345110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:13.345559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:13.546225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:13.549645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:13.557749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-da8c3541-81b9-402c-9b73-4c54dd87fd63 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.229097 Aug 24 16:11:13.558556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1839/3637] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:13 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:13.574351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9c1bde9d-68fc-42c8-a6df-6176d63703fe tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.247744 Aug 24 16:11:13.575231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1799/3638] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:13 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:13.576804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:13.577507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:13.584101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:13.584592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:13.585027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:13.585844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:13.586304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:13.586731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:13.718980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:13.727172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ccf8e090-31c6-4c24-a441-4f635751eb9b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.167908 Aug 24 16:11:13.727768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1840/3639] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:13 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:14.586610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:14.587220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:14.594708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:14.595202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:14.595806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:14.596256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:14.596417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:14.596543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:14.597089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:14.597415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:14.602736 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:14.603214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:14.603769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:14.604352 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:14.605384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:14.605812 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:14.624050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:14.799019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:14.806157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:14.807482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0d2aa0eb-77b6-46f6-9579-89c8db1b26d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225024 Aug 24 16:11:14.808726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1800/3640] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:14 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:14.813323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:14.813924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:14.815256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c6595b76-554a-48b2-971f-e260eff8b22a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.223203 Aug 24 16:11:14.821774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1841/3641] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:14.821943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:14.821943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:14.821943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:14.821943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:14.822310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:14.822310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:14.959374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:14.968256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e42352d4-1759-48e0-a0b4-09314708f718 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.158585 Aug 24 16:11:14.968813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1801/3642] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:14 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:15.828989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:15.829706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:15.836706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:15.836949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:15.837425 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:15.837551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:15.837654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:15.838291 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:15.839256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:15.839719 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:15.846429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:15.846956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:15.847342 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:15.848068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:15.848520 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:15.848943 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:16.037353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:16.040512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:16.046372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d3bd7af2-89e8-425b-88b2-e450ca04bc7d tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221186 Aug 24 16:11:16.046946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1842/3643] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:15 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:16.050550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-90679ead-a98c-47d7-abdc-e27ef643842b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217346 Aug 24 16:11:16.051346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:16.052019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:16.057829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:16.058306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:16.058944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:16.059658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:16.060188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:16.060611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:16.064703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1802/3644] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:16.203133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:16.211529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d6af81c1-79c9-4e7f-ae1f-ce9db7e8ce2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.163649 Aug 24 16:11:16.212122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1843/3645] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:16 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:17.070357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:17.070961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:17.072815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:17.074141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:17.077989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:17.078483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:17.078926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:17.079658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:17.080115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:17.080544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:17.081035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:17.081555 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:17.081980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:17.082936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:17.083397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:17.083943 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:17.280773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:17.287720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:17.289199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-858a9f80-6c0d-4f5c-9009-2e1a087e8fb2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222713 Aug 24 16:11:17.289776 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1803/3646] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:17 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:17.294296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:17.294979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:17.297161 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b863b3e1-8401-4312-95a0-64da6a5bace9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.229025 Aug 24 16:11:17.303270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1844/3647] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:17.303466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:17.303466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:17.303466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:17.303466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:17.303897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:17.303897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:17.431010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:17.440233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-03728121-208c-4c15-9ef5-60c30bfbb38c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.149486 Aug 24 16:11:17.440802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1804/3648] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:17 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:18.310246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:18.310973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:18.317563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:18.318028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:18.318436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:18.318558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:18.318674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:18.319186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:18.319664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:18.320156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:18.325109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:18.325599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:18.326033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:18.326759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:18.327222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:18.327682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:18.518366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:18.522532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:18.527964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-061f8bbf-b348-43aa-92d6-8d19f0f30c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220708 Aug 24 16:11:18.528766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1845/3649] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:18 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:18.531607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f80e3702-be7f-4802-81ca-2091a2a8ff61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217292 Aug 24 16:11:18.532344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1805/3650] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:18.536051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:18.536660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:18.542612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:18.543099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:18.543525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:18.544241 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:18.544692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:18.545117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:18.680198 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:18.691082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-826fb8ea-6377-4ffe-9704-7ae840188dd3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159426 Aug 24 16:11:18.691673 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1846/3651] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:18 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:19.549856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:19.550495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:19.552811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:19.553450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:19.557165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:19.558632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:19.559186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:19.560002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:19.560455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:19.560857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:19.560981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:19.561329 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:19.561830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:19.562452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:19.562910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:19.563334 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:19.752774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:19.761937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:19.762481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e66f83c0-721f-440c-be88-dd647c9f153e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.213145 Aug 24 16:11:19.763155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1847/3652] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:19 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:19.769298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:19.770277 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:19.773017 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-005a7544-5bc9-4d38-b9c0-0a8038a29bfe tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226768 Aug 24 16:11:19.774191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1806/3653] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:19 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:19.778054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:19.778723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:19.779234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:19.779978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:19.780584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:19.781099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:19.920485 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:19.929383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b51d4bc8-7acc-4e6c-92c5-dd9ec146e7c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.165073 Aug 24 16:11:19.929982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1848/3654] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:19 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:20.786217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:20.787064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:20.793747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:20.794240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:20.795289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:20.796048 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:20.796506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:20.796935 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:20.797533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:20.798144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:20.804305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:20.804806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:20.805234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:20.805910 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:20.806362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:20.806783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:20.994125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:20.997211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:21.002512 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-940c7be3-98ee-4af2-961b-6b117af0e5b4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220112 Aug 24 16:11:21.005802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1807/3655] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:21.005962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-afccdc3e-8811-4ac9-831e-0753b1055b06 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.211472 Aug 24 16:11:21.005962 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1849/3656] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:20 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:21.007500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:21.008262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:21.014737 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:21.015223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:21.015685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:21.016388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:21.016844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:21.017287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:21.145753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:21.154087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b821388b-5764-40ac-b2b4-505582fe4364 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.150047 Aug 24 16:11:21.154661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1808/3657] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:21 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:22.023734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:22.024285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:22.028222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:22.028844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:22.031956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:22.032460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:22.032895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:22.033594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:22.034062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:22.034495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:22.035434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:22.035981 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:22.036415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:22.037115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:22.037577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:22.038009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:22.230462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:22.234495 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:22.238981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-be1df967-76a5-48b0-898e-09ea085b363a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219402 Aug 24 16:11:22.239666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1850/3658] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:22.243351 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d3ff021d-db05-47cf-bfdc-63640f44eac4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.219453 Aug 24 16:11:22.243959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1809/3659] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:22 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:22.244125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:22.244706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:22.250990 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:22.251479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:22.251952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:22.252652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:22.253099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:22.253520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:22.387783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:22.396078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a1c0d8e5-ebcd-4f89-bf05-80bb2e8010f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.155434 Aug 24 16:11:22.396648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1851/3660] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:22 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:23.260292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:23.262491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:23.267531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:23.268175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:23.268306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:23.268682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:23.269120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:23.269853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:23.270311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:23.270741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:23.274775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:23.275268 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:23.275739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:23.276473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:23.277007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:23.277439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:23.289348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:23.475708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:23.478541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:23.484668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e8e840ec-92c7-4a89-a2e4-e8d6e75a124f tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.228244 Aug 24 16:11:23.485240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1810/3661] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:23.487529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4b402989-e13f-493d-9b97-049035d3ffa5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223733 Aug 24 16:11:23.491468 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1852/3662] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:23 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:23.491678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:23.491678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:23.496554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:23.497035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:23.497466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:23.498156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:23.498602 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:23.499227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:23.634833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:23.643292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b6fcf402-1094-4ed0-ba1a-d7b4e273d48c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.157121 Aug 24 16:11:23.643908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1811/3663] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:23 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:24.506536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:24.507175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:24.508492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:24.509107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:24.514488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:24.514987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:24.515426 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:24.515555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:24.515967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:24.516159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:24.516404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:24.516620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:24.517053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:24.517583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:24.518050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:24.518480 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:24.730397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:24.734797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:24.739045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-50ca4fa3-1e6c-4989-8b20-71ef755f4c28 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.236390 Aug 24 16:11:24.739623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1853/3664] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:24.743013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-adedb3ad-8e06-46ec-b7b7-c7f03423eae1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.238240 Aug 24 16:11:24.743676 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1812/3665] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:24 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:24.744233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:24.744895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:24.751692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:24.752247 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:24.752683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:24.753371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:24.753818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:24.754237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:24.883110 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:24.901149 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c9a5f5f2-7ec4-4570-b348-e96ebc0f2593 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.160417 Aug 24 16:11:24.901747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1854/3666] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:24 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:25.761897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:25.762661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:25.765204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:25.765863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:25.769438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:25.769921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:25.770361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:25.771059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:25.771514 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:25.771870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:25.772006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:25.772362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:25.772798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:25.773501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:25.773965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:25.774396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:26.191336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:26.194367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:26.200282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10fd62e9-bc85-4ef4-9b90-2d57ad634145 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.439980 Aug 24 16:11:26.200961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1855/3667] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:25 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:26.203661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-82faf91b-0d67-4ccd-b13a-6fcb2e1e3724 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.445783 Aug 24 16:11:26.204436 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1813/3668] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:26.205629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:26.206310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:26.212479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:26.213043 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:26.213575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:26.214928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:26.215462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:26.215984 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:26.342026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:26.350257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bea5a10e-0efd-43ff-86fe-061230e5fd4d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.148285 Aug 24 16:11:26.350823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1856/3669] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:26 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:27.223348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:27.223982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:27.224741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:27.225359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:27.230933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:27.231424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:27.231890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:27.232524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:27.232663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:27.233019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:27.233248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:27.233458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:27.233709 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:27.234158 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:27.234620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:27.235049 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:27.443552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:27.446817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:27.453300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bdf04eb3-6e62-4796-8dc2-e5c544e772be tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.233797 Aug 24 16:11:27.453894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1814/3670] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:27 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:27.456196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0ef6ffad-0f8b-462c-8d9a-82b570b3165b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.235164 Aug 24 16:11:27.456921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1857/3671] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:27.458579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:27.459187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:27.466031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:27.466523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:27.466963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:27.467691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:27.468152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:27.468581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:27.605875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:27.614646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e317b216-c9ff-4977-a1ae-9e1392f236d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159755 Aug 24 16:11:27.615442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1815/3672] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:27 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:28.474875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:28.475502 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:28.477083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:28.477701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:28.477868 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=78 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:28.483688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:28.484187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:28.484327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:28.484630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:28.484759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:28.485200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:28.485326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:28.485779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:28.485903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:28.486266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:28.486393 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:28.486750 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:28.490534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:28.681725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:28.686343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:28.690568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-91ffe994-37f4-41d2-a5ac-1d55bd398788 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217341 Aug 24 16:11:28.695271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1816/3673] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:28.695435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e99dec06-48a5-42f9-b988-617f993fd9dc tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223888 Aug 24 16:11:28.695435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1858/3674] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:28 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:28.695611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:28.696198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:28.704712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:28.706140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:28.706769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:28.707757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:28.708210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:28.708812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:28.841949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:28.853186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3a0d0c84-a90f-425a-904d-900a03438194 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.160993 Aug 24 16:11:28.853774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1817/3675] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:28 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:29.716829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:29.717448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:29.719457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:29.720124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:29.722417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=70 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:29.724174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:29.724650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:29.725085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:29.725781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:29.726236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:29.726661 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:29.727492 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:29.728002 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:29.728435 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:29.729128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:29.729576 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:29.729997 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:29.921631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:29.928531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:29.929939 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fc866b88-56a7-487a-a25b-f60e1cfd7cef tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.217849 Aug 24 16:11:29.930715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1859/3676] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:29.936288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:29.936905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:29.937695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d1a59420-dc5e-4782-94ea-0f9ddd02b9e1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.222673 Aug 24 16:11:29.943144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:29.943671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:29.944105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:29.944814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:29.945276 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:29.945704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:29.950372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1818/3677] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:29 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:30.085135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:30.093630 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6662fd57-d94b-42e4-ad61-ca0e657de58b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.161402 Aug 24 16:11:30.094201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1860/3678] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:29 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:30.952348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:30.952949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:30.959099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:30.959820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:30.961671 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:30.962167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:30.962660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:30.963373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:30.964124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:30.964649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:30.967150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:30.967642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:30.968087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:30.968777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:30.969228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:30.969649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:31.171144 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:31.178071 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:31.179423 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb7bc613-4067-422a-b225-e5c656da281b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.224472 Aug 24 16:11:31.180041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1861/3679] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:30 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:31.184441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:31.185262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:31.186870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-291d6d66-2b97-4d98-973f-155315f81e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.239260 Aug 24 16:11:31.187615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1819/3680] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:31.191168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:31.191681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:31.192124 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:31.192827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:31.193285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:31.193850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:31.322850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:31.332120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-333fe197-2687-4311-a186-d30a35f568c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.150978 Aug 24 16:11:31.332880 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1862/3681] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:31 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:32.199593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:32.200278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:32.207233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:32.208015 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:32.208451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:32.209149 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:32.209604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:32.209843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:32.210337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:32.210446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:32.217194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:32.217765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:32.218179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:32.219050 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:32.219510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:32.219974 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:32.412553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:32.415926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:32.421753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5d2c3e03-49c1-447d-b405-564938194902 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.225974 Aug 24 16:11:32.422327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1820/3682] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:32 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:32.424875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0dd7d7b1-b905-4c25-b6e4-31a5d73160a8 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219187 Aug 24 16:11:32.425590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1863/3683] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:32.426895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:32.427501 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:32.433447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:32.434006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:32.434441 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:32.435126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:32.435573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:32.436178 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:32.574318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:32.583062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f05fb11f-38cc-4ee4-86b5-c8c9399f0757 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159630 Aug 24 16:11:32.583660 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1821/3684] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:32 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:33.443283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:33.443925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:33.445847 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:33.446464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:33.451401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:33.451919 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:33.452357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:33.453054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:33.453509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:33.453840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:33.453964 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:33.454327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:33.454763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:33.455457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:33.455978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:33.456365 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:33.652210 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:33.655406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:33.661289 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0ac0d3a0-4489-47bb-843b-658e0c2e418f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.221832 Aug 24 16:11:33.661866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1864/3685] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:33 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:33.675507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-90a084e7-e416-48c6-8be0-90b0a4204215 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.221597 Aug 24 16:11:33.675507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1822/3686] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:33 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:33.675824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:33.675824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:33.675824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:33.675824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:33.676207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:33.676207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:33.676207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:33.676466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:33.806514 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:33.815254 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1a5c0d33-4621-46c0-853c-408720f6823b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152450 Aug 24 16:11:33.815842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1865/3687] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:33 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:34.684068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:34.684944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:34.685227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:34.685969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:34.691443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:34.691956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:34.692310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:34.692439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:34.692797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:34.693061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:34.693233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:34.693506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:34.693935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:34.694103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:34.694384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:34.694811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:34.898116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:34.901350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:34.907067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fba7c685-637c-47b7-a7eb-af9823d0ad3e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.226158 Aug 24 16:11:34.907823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1866/3688] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:34.910858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e8c11da-9eb5-43ff-aadf-6f29b969a5d2 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230939 Aug 24 16:11:34.911775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1823/3689] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:34 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:34.913118 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:34.913743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:34.922624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:34.923119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:34.923563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:34.924307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:34.924775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:34.925222 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:35.067409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:35.075682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-658431e2-1701-4c35-be50-8b36db36754f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.166808 Aug 24 16:11:35.076262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1867/3690] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:34 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:35.928972 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:35.929608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:35.931078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:35.931738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:35.937288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:35.938141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:35.938577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:35.939031 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:35.939279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:35.939532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:35.940013 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:35.940717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:35.941177 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:35.941611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:35.949357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:35.949824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:36.142582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:36.150929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ca3b519a-7915-4011-9734-745c81558b7e tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223611 Aug 24 16:11:36.151503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1868/3691] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:35 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:36.156025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:36.156269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:36.156873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:36.163152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:36.163664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:36.164097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:36.164788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:36.165236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:36.165379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9d5b040-8a99-4d3a-acc3-f2df60c14a66 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.240098 Aug 24 16:11:36.165657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:36.166067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1824/3692] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:36.300472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:36.308651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-10b9ac72-8a1c-4094-a180-cf8e1a29ba49 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.156116 Aug 24 16:11:36.309157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1869/3693] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:36 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:37.172594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:37.173190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:37.179553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:37.180060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:37.180491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:37.181201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:37.181649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:37.182158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:37.188017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:37.188634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:37.195040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:37.195527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:37.196004 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:37.196702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:37.197168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:37.197599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:37.390025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:37.393780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:37.398614 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-742b9aeb-466b-4b6c-9999-3fccddf60dee tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.230017 Aug 24 16:11:37.399191 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1825/3694] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:37 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:37.402105 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5de5c915-98f3-4038-b906-4b86261dc9ba tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.218675 Aug 24 16:11:37.402827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1870/3695] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:37.403841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:37.404468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:37.410784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:37.410784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:37.411183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:37.411909 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:37.412364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:37.412796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:37.546014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:37.554166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8a31c3e6-f386-4bc7-84e9-f56d0d5ab4ec tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.154011 Aug 24 16:11:37.554728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1826/3696] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:37 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:38.422479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:38.423069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:38.423458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:38.423788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:38.429931 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:38.430559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:38.430733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:38.430993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:38.431288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:38.431706 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:38.431904 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:38.432269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:38.432659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:38.432790 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:38.433195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:38.433635 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:38.439589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:38.631890 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:38.634553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:38.640690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-941c4741-ace6-4076-b39e-c6fe7f847809 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222106 Aug 24 16:11:38.641891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1827/3697] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:38.642770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-190187fa-f7ac-4f76-9d33-d856c9f6b66c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.226409 Aug 24 16:11:38.643471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1871/3698] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:38 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:38.646554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:38.647233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:38.653247 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:38.653862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:38.654307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:38.655693 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:38.656200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:38.656580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:38.792305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:38.801839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2a489e7c-4542-4242-a00c-a1da5ff75eab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.159543 Aug 24 16:11:38.802406 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1828/3699] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:38 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:39.663012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:39.663665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:39.669031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:39.669786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:39.670772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:39.671462 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:39.672442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:39.673180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:39.673650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:39.674080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:39.676921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:39.677437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:39.678047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:39.678574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:39.679030 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:39.679488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:39.888523 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:39.895171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:39.897186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14d8061f-6ec2-4a22-93f4-760dae87caf7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.237944 Aug 24 16:11:39.897770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1872/3700] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:39.902654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:39.903256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:39.904204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-61a04680-afc9-4429-a8e0-842ebd3807c1 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.238944 Aug 24 16:11:39.905215 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1829/3701] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:39 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:39.909676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:39.910179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:39.910615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:39.911316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:39.911809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:39.912649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:40.063516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:40.071881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ca5f53f-9dcf-4c58-820d-16be6dcdee86 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.172922 Aug 24 16:11:40.072658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1873/3702] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:39 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:40.917906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:40.918552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:40.925813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:40.926079 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:40.926552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:40.926684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:40.926797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:40.927413 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:40.927902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:40.928329 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:40.932595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:40.933090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:40.933532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:40.934232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:40.934687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:40.935112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:41.138899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:41.142588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:41.145925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:41.148362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7625bceb-fe6d-41e3-b8eb-7691b64ca260 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.234521 Aug 24 16:11:41.148983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1830/3703] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:40 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:41.151710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b7a6a358-1d61-4d07-b717-ed0082e0b68c tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.229753 Aug 24 16:11:41.152273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1874/3704] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:40 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:41.153701 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:41.154316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:41.160330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:41.160812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:41.161487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:41.162188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:41.162648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:41.163073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:41.290605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:41.299383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6dee9618-da00-45c8-8d79-ce802b06eeb7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.149456 Aug 24 16:11:41.299986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1831/3705] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:41 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:42.169824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:42.170427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:42.172818 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:42.173439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:42.177507 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:42.177996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:42.178434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:42.179134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:42.179380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:42.179589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:42.179894 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:42.180028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:42.180332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:42.181036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:42.181497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:42.181927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:42.376582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:42.383383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:42.385224 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-75f74fc5-8c54-4936-9423-34c7db96d88e tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.219198 Aug 24 16:11:42.385807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1875/3706] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:42.391398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:42.392047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:42.392457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-29b17a8c-e613-461a-8b1a-480f57e58002 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.223811 Aug 24 16:11:42.399397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:42.399999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:42.400442 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:42.401145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:42.401607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:42.402032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:42.406570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1832/3707] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:42 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:42.538512 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:42.546830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-57ed5fca-247a-43da-b260-acefb18fb5b6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.160064 Aug 24 16:11:42.547398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1876/3708] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:43.407281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:43.408859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:43.414083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:43.414588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:43.414714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:43.415016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:43.415456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:43.416197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:43.416656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:43.417085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:43.421121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:43.422283 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:43.422762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:43.423670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:43.424249 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:43.424786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:43.614371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:43.617466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:43.623357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da8d34b5-14e3-45e7-83eb-b41cd81e6fda tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.220628 Aug 24 16:11:43.624014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1833/3709] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:43.626197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-37964f66-56c4-4844-8080-825885b67d7f tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.215938 Aug 24 16:11:43.626770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1877/3710] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:43 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:43.628564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:43.629170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:43.634973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:43.635453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:43.635928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:43.636620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:43.637073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:43.637496 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:43.776956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:43.786306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9cd50489-aaef-41f5-adef-04a9955f6856 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.161267 Aug 24 16:11:43.786871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1834/3711] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:43 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:44.645377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:44.646025 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:44.648222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:44.648840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:44.652557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:44.653042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:44.653482 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:44.654179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:44.654629 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:44.655054 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:44.655728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:44.656834 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:44.657284 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:44.658006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:44.658468 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:44.658903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:44.851928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:44.854735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:44.861594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d8c9f55c-a20b-466a-a663-c0ae2512579b tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.216544 Aug 24 16:11:44.862076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1835/3712] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:44 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:44.864263 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a209cb79-2739-48c3-b12f-2a58f6ae8eff tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222716 Aug 24 16:11:44.865168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1878/3713] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:44.866674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:44.867277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:44.873120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:44.873599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:44.874085 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:44.874780 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:44.875431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:44.875826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:45.004529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:45.012783 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-40bc1fc0-f07c-4379-befb-df08cc07b092 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.149721 Aug 24 16:11:45.013339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1836/3714] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:44 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:45.882336 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:45.882954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:45.885313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:45.885927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:45.889663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:45.890156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:45.890767 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:45.891475 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:45.891965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:45.892399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:45.892525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:45.892958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:45.893387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:45.894079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:45.894534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:45.894957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:46.107138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:46.112237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:46.116500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c92f0569-474c-491c-93ad-90c851014cf3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.238134 Aug 24 16:11:46.117171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1879/3715] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:45 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:46.121384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4608fe78-715b-4ba4-984b-3cca74999e02 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.238916 Aug 24 16:11:46.121384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1837/3716] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:45 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:46.121983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:46.122659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:46.129517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:46.130096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:46.130600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:46.131378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:46.131858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:46.132285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:46.262272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:46.270683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ec2bee34-3336-466b-b99a-06fd905e2ae7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152437 Aug 24 16:11:46.271251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1880/3717] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:46 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:47.138481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:47.139195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:47.144371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:47.145017 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:47.145811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:47.146315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:47.147619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:47.147619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:47.147996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:47.148419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:47.151159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:47.151665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:47.152113 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:47.152822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:47.153282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:47.153713 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:47.344800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:47.347715 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:47.353106 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-da76b119-adc1-4f89-a16a-cd3c4f68350a tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.218554 Aug 24 16:11:47.353681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1838/3718] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:47 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:47.355925 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-66c53b5f-68c4-4b4d-b61c-1b5c75aa4c4d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.215633 Aug 24 16:11:47.359670 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1881/3719] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:47 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:47.359835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:47.359835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:47.365176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:47.365788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:47.366326 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:47.367122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:47.367579 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:47.368039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:47.498357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:47.507141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bbca8cfd-7eae-4f09-b24f-29b32f332aed tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.152506 Aug 24 16:11:47.507725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1839/3720] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:47 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:48.374851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:48.376100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:48.376433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:48.377045 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:48.382874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:48.383367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:48.383517 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:48.383836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:48.383953 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:48.384360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:48.384567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:48.385030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:48.385185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:48.385466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:48.385638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:48.386056 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:48.582275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:48.585486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:48.590969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9a90e900-8794-4b87-a296-8d5ebfa1d9d9 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220168 Aug 24 16:11:48.591546 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1882/3721] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:48 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:48.594320 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0c10d04f-954c-4b9e-b1d6-af585b6df20d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222269 Aug 24 16:11:48.595036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1840/3722] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:48 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:48.597220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:48.598530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:48.604164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:48.604654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:48.605089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:48.605789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:48.606243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:48.606667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:48.736351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:48.744438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-710abe7f-752e-4cda-85ba-af6c3278c9f8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.151925 Aug 24 16:11:48.745002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1883/3723] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:48 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:49.613650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:49.614269 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:49.614935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:49.615881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:49.620687 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:49.621171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:49.621601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:49.622296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:49.622421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:49.622748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:49.622908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:49.623167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:49.623365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:49.624917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:49.625395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:49.625817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:49.821044 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:49.825478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:49.830070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4c850265-3ba5-4d44-afca-75063f8e6cf0 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.220573 Aug 24 16:11:49.830658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1841/3724] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:49 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:49.834099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5674516a-0b16-4cd1-92ef-c5277d069e35 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.222901 Aug 24 16:11:49.834664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1884/3725] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:49 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:49.835295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:49.836061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:49.841956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:49.842440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:49.842881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:49.843582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:49.844055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:49.844545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:49.979330 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:49.988327 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-26dd9e0a-fa14-4d80-b997-752f3ed10128 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 200 len: 1729 microversion: 2.1 time: 0.156705 Aug 24 16:11:49.988902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1842/3726] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:49 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:50.009674 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a85d628d-16aa-4230-b9e7-4c40046ff1db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '.version_select at 0x7fc5cca393a0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:50.014171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a85d628d-16aa-4230-b9e7-4c40046ff1db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [c49020a8-fa05-454a-a78e-b92b1d69340e] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:11:50.851649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:50.852628 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: c5e42f6c-3744-4979-9c73-20f918be2be6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:50.859303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:50.859829 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:50.860273 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:50.860980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:50.861434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:50.861859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:51.001076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:51.004853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:51.010606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5658bd94-53c0-40b2-8a93-0da1f457bd92 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6" status: 200 len: 1738 microversion: 2.1 time: 0.162794 Aug 24 16:11:51.011184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1843/3727] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:50 2022] GET /compute/v2.1/servers/c5e42f6c-3744-4979-9c73-20f918be2be6 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:51.024261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:51.024261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:51.024261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:51.024261 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:51.024632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:51.024768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:51.025229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:51.025900 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:51.035662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [None req-a85d628d-16aa-4230-b9e7-4c40046ff1db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [c49020a8-fa05-454a-a78e-b92b1d69340e] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 40956. Aug 24 16:11:51.057613 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a85d628d-16aa-4230-b9e7-4c40046ff1db tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547664228" status: 202 len: 0 microversion: 2.1 time: 1.051492 Aug 24 16:11:51.058009 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1885/3728] 10.222.0.102 () {58 vars in 1223 bytes} [Wed Aug 24 16:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547664228 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:11:51.072078 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e764e4ec-e83c-4d35-8ef3-e255b58e2250 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '.version_select at 0x7fc5d126ef70>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:51.115303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e764e4ec-e83c-4d35-8ef3-e255b58e2250 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003450538" status: 202 len: 0 microversion: 2.1 time: 0.055767 Aug 24 16:11:51.116854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1886/3729] 10.222.0.102 () {58 vars in 1226 bytes} [Wed Aug 24 16:11:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003450538 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:11:51.193133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:51.201581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-12a51bef-5f65-4206-9bec-c0ed89157520 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.189389 Aug 24 16:11:51.202221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1844/3730] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:51 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:52.224592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:52.225214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:52.240642 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:52.241500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:52.242181 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:52.243160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:52.243892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:52.244553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:52.288745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-211b604e-c46d-4fc5-a105-0ad1ab47eaac req-77097f77-0b0e-46cc-a809-3aa54f489c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a234e501-bc78-49d3-840c-65ec61718cc0", "tag": "964ad286-e8b3-4ae1-bbea-f1b129ebb9ee"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:11:52.309604 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-211b604e-c46d-4fc5-a105-0ad1ab47eaac req-77097f77-0b0e-46cc-a809-3aa54f489c5a service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:52.316455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-211b604e-c46d-4fc5-a105-0ad1ab47eaac req-77097f77-0b0e-46cc-a809-3aa54f489c5a service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:52.316902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-211b604e-c46d-4fc5-a105-0ad1ab47eaac req-77097f77-0b0e-46cc-a809-3aa54f489c5a service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:52.341940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-211b604e-c46d-4fc5-a105-0ad1ab47eaac req-77097f77-0b0e-46cc-a809-3aa54f489c5a service nova] Creating event network-changed:964ad286-e8b3-4ae1-bbea-f1b129ebb9ee for instance a234e501-bc78-49d3-840c-65ec61718cc0 on hv-cinder-84932 Aug 24 16:11:52.360510 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-211b604e-c46d-4fc5-a105-0ad1ab47eaac req-77097f77-0b0e-46cc-a809-3aa54f489c5a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072960 Aug 24 16:11:52.361621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1845/3731] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:11:52.488518 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:52.529802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1d8e81b8-f167-4e50-b786-c71e60c2c2c3 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.309925 Aug 24 16:11:52.536012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6561b0f8-7ef4-45a0-9a47-d6a4a96f7304 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: .version_select at 0x7fc5cd3ddaf0>, body: {"keypair": {"name": "tempest-keypair-1422605883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/2weVrOR+om8GgcLvl7RRJr512XEBd51o6sbg+FbaaQjryR10Y0lqWZ9NQyAS3aaGqwpCzCM84nGrWpUtR6T+GYV9/lRFckxBY0v9B0hGP1csl/r07Cr0l8/U02Tiu5Q=="}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:11:52.540750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1887/3732] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:52 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:52.562543 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-6561b0f8-7ef4-45a0-9a47-d6a4a96f7304 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:11:52.566779 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-6561b0f8-7ef4-45a0-9a47-d6a4a96f7304 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:11:52.599817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6561b0f8-7ef4-45a0-9a47-d6a4a96f7304 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068110 Aug 24 16:11:52.601019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1846/3733] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 16:11:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:11:52.648398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-fa38343e-5367-4f24-b1ec-240619aad6e3 req-6f92c084-5bbd-4613-b165-30fbb9dd8ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:11:52.661021 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-fa38343e-5367-4f24-b1ec-240619aad6e3 req-6f92c084-5bbd-4613-b165-30fbb9dd8ec4 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:52.661800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-fa38343e-5367-4f24-b1ec-240619aad6e3 req-6f92c084-5bbd-4613-b165-30fbb9dd8ec4 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:52.662393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-fa38343e-5367-4f24-b1ec-240619aad6e3 req-6f92c084-5bbd-4613-b165-30fbb9dd8ec4 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:52.679800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-fa38343e-5367-4f24-b1ec-240619aad6e3 req-6f92c084-5bbd-4613-b165-30fbb9dd8ec4 service nova] Creating event network-changed:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 16:11:52.685835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-fa38343e-5367-4f24-b1ec-240619aad6e3 req-6f92c084-5bbd-4613-b165-30fbb9dd8ec4 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138707 Aug 24 16:11:52.688467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1888/3734] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:11:53.562141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:53.562141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:53.573666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:53.576256 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:53.576933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:53.582163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:53.583140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:53.583942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:53.860197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:53.870267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d7a7b14e-c2bf-44e5-94b9-bc6bf137fd56 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.315112 Aug 24 16:11:53.870983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1847/3735] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:53 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:54.272978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2144968410", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "865ac09d-5307-48a3-bc8a-ec402499204e"}], "security_groups": [{"name": "tempest-securitygroup--812865007"}], "key_name": "tempest-keypair-1422605883", "user_data": "}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:11:54.376553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] validate_networks() for [('865ac09d-5307-48a3-bc8a-ec402499204e', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:11:54.816129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:11:54.816564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:11:54.817045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:11:54.817460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:11:54.817878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:11:54.827318 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:54.828172 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:54.828607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:54.829431 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:54.829882 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:54.830307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:54.853878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:11:54.858099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:11:54.871614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:11:54.875382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:11:54.892760 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:54.893424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:54.900267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:54.900753 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:54.901193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:54.901891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:54.902345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:54.902772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:54.926510 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1f703392-563f-493f-a6d9-fbba2f08d000 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.658851 Aug 24 16:11:54.927353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1889/3736] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 16:11:54 2022] POST /compute/v2.1/servers => generated 403 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 16:11:54.938166 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a2ec5cf8-a873-4839-9a7c-f26f842f115d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:54.938783 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a2ec5cf8-a873-4839-9a7c-f26f842f115d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:55.003396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a2ec5cf8-a873-4839-9a7c-f26f842f115d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:55.011132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a2ec5cf8-a873-4839-9a7c-f26f842f115d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1246 microversion: 2.1 time: 0.077226 Aug 24 16:11:55.011709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1890/3737] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:54 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:55.062694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:55.071003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0b4d87f3-9ad8-4add-83cf-51bcde30ca20 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.182346 Aug 24 16:11:55.071503 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1848/3738] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:54 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:56.032419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-52a71593-f197-442c-9003-6ef9e22b4348 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:56.033036 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-52a71593-f197-442c-9003-6ef9e22b4348 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:56.090872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-52a71593-f197-442c-9003-6ef9e22b4348 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:56.092432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:56.093102 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:56.098461 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-52a71593-f197-442c-9003-6ef9e22b4348 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1246 microversion: 2.1 time: 0.070528 Aug 24 16:11:56.099218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1891/3739] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:56 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:56.099886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:56.100400 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:56.100830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:56.101530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:56.101979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:56.102429 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:56.231490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:56.240897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6e60ea1e-ad20-435c-aced-b5718a90d1c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152208 Aug 24 16:11:56.241482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1849/3740] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:56 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:11:57.119111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-35702af7-d854-460f-9fc2-eb56cbaa1689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:57.119843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-35702af7-d854-460f-9fc2-eb56cbaa1689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:57.174239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-35702af7-d854-460f-9fc2-eb56cbaa1689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:57.181045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-35702af7-d854-460f-9fc2-eb56cbaa1689 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1246 microversion: 2.1 time: 0.065696 Aug 24 16:11:57.181531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1892/3741] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:57 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:57.261597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:57.262213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:57.269290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:57.269772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:57.270213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:57.270905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:57.271357 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:57.271812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:57.404059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:57.412990 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-428c2954-ae58-4f22-818d-d44141a9de75 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.155312 Aug 24 16:11:57.413555 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1850/3742] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:57 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:58.201542 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30f2276e-203c-4b7d-b3ad-dffb974f1d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:58.202193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-30f2276e-203c-4b7d-b3ad-dffb974f1d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:58.263953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-30f2276e-203c-4b7d-b3ad-dffb974f1d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:58.271145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-30f2276e-203c-4b7d-b3ad-dffb974f1d7f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1246 microversion: 2.1 time: 0.073547 Aug 24 16:11:58.271698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1893/3743] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:58 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:58.433613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:58.434125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:58.441645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:58.442133 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:58.442632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:58.443343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:58.443830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:58.444258 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:58.578305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:58.586785 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f784c3a5-87c0-46fd-897c-181bf19b86f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.157232 Aug 24 16:11:58.587354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1851/3744] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:58 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:59.292483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:59.293099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:59.296092 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:11:59.302963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:59.303452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:59.303920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:59.304612 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:59.305069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:59.305498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:59.369123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:59.377831 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-11e3bf20-4078-4acc-a26c-f3d833846241 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1250 microversion: 2.1 time: 0.089171 Aug 24 16:11:59.378415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1894/3745] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:59 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:11:59.610181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:11:59.611108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:11:59.617471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:59.617948 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:59.618384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:59.619086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:11:59.619522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:11:59.620433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:11:59.771164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:11:59.780455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2b51f8a3-990e-4c4b-b716-4601c2b36c61 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.174548 Aug 24 16:11:59.781052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1852/3746] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:11:59 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:00.398685 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:00.399302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:00.431789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:00.431789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:00.431789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:00.431789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:00.432285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:00.432285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:00.485834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:00.493978 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c80ef5ae-bce5-469b-a6f1-1391c0340bab tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1304 microversion: 2.1 time: 0.099381 Aug 24 16:12:00.494620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1895/3747] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:00 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:00.806463 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:00.807086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:00.809575 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:00.818117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:00.818613 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:00.819055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:00.819813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:00.820275 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:00.820700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:00.985016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:00.995391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5d6d1e7e-2c4e-48bb-9785-d4f1815bf242 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.196500 Aug 24 16:12:00.995941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1853/3748] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:00 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:01.453920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-e5edd3e8-65dc-4831-b283-45f1283238de req-d37ece06-49af-4df2-9976-83d9855f1287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418de9ef-d5ca-47f7-95db-e7b136f7bae2", "tag": "8e5d2b1b-a116-4948-a8c8-cfcf76c01372"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:12:01.464343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e5edd3e8-65dc-4831-b283-45f1283238de req-d37ece06-49af-4df2-9976-83d9855f1287 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:01.464863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e5edd3e8-65dc-4831-b283-45f1283238de req-d37ece06-49af-4df2-9976-83d9855f1287 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:01.465303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e5edd3e8-65dc-4831-b283-45f1283238de req-d37ece06-49af-4df2-9976-83d9855f1287 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:01.488559 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-e5edd3e8-65dc-4831-b283-45f1283238de req-d37ece06-49af-4df2-9976-83d9855f1287 service nova] Creating event network-changed:8e5d2b1b-a116-4948-a8c8-cfcf76c01372 for instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 on hv-cinder-84932 Aug 24 16:12:01.493946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-e5edd3e8-65dc-4831-b283-45f1283238de req-d37ece06-49af-4df2-9976-83d9855f1287 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044176 Aug 24 16:12:01.494412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1896/3749] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:12:01.516851 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:01.517466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:01.523577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:01.524123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:01.524561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:01.525262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:01.525714 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:01.526138 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:01.667599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:01.675298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a11de6da-c4f6-4c67-84dc-cc424ff33692 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.162843 Aug 24 16:12:01.676141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1854/3750] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:01 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:02.018647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:02.019256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:02.025390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:02.025870 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:02.026302 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:02.026986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:02.027447 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:02.027902 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:02.157590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:02.165649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8f78ff0f-1868-4027-b734-57f3f881eb6b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152083 Aug 24 16:12:02.166216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1897/3751] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:02 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:02.696038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:02.696639 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:02.698929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=4 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:02.704189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:02.704666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:02.705095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:02.705775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:02.706220 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:02.706637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:02.839777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:02.848826 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-abd44d62-231c-4731-9aa8-193efc165855 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.155984 Aug 24 16:12:02.848931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1855/3752] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:02 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:03.186473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:03.187085 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:03.193659 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:03.194154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:03.194616 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:03.195323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:03.195818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:03.196251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:03.333941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:03.344436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c0f87acb-2102-4c7e-ad8d-1724fc921189 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.161458 Aug 24 16:12:03.345304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1898/3753] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:03 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:03.869193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:03.869801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:03.877757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:03.878250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:03.878691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:03.879395 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:03.879889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:03.880321 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:04.012748 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:04.020457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f28b0a60-af94-4ed8-a9e2-fbc5d9ec86b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.155137 Aug 24 16:12:04.021019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1856/3754] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:03 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:04.366965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:04.367801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:04.374915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:04.375421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:04.375890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:04.376584 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:04.377038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:04.377467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:04.395583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:04.506636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:04.515389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-78e17add-8bc6-441e-893f-c82737d292ae tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152166 Aug 24 16:12:04.515976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1899/3755] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:04 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:05.041566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:05.042184 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:05.048624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:05.049108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:05.049542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:05.050240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:05.050694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:05.051124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:05.182767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:05.191052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c30b75de-f466-4305-9773-10ad046207dc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.153364 Aug 24 16:12:05.191618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1857/3756] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:05 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:05.536284 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:05.536821 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:05.538683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:05.544608 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:05.545090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:05.546032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:05.546727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:05.547180 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:05.547605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:05.678498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:05.687196 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-78c9debf-728f-4932-bef6-0fd3c27d2ede tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154326 Aug 24 16:12:05.687794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1900/3757] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:05 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:06.212308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:06.212912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:06.220046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:06.220521 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:06.220957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:06.221656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:06.222359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:06.222835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:06.360731 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:06.368317 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eae9453b-9ae5-49be-b4e4-1e4124f003aa tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.160141 Aug 24 16:12:06.368882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1858/3758] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:06 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:06.708820 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:06.709439 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:06.715897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:06.716392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:06.716838 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:06.718243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:06.718750 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:06.719214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:06.859476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:06.867600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bb5dfd85-ef5d-4b2e-8470-f9056e1141c4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.163144 Aug 24 16:12:06.868185 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1901/3759] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:06 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:07.388032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:07.388770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:07.395264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:07.395787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:07.396222 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:07.396923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:07.397372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:07.397800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:07.530768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:07.538500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d791f4e3-30f8-4d22-81b1-fa23c2e0bf70 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.154319 Aug 24 16:12:07.539221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1859/3760] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:07 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:07.888435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:07.889657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:07.896532 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:07.897026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:07.897465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:07.898173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:07.898631 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:07.899132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:08.035404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:08.043556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-591863d5-2ec3-4b95-ad20-3b5b4a4eeed0 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158998 Aug 24 16:12:08.044160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1902/3761] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:07 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:08.564437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:08.565578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:08.576830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:08.577722 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:08.578519 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:08.579794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:08.580638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:08.581423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:08.720172 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:08.727869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c8f97625-e50e-4b6a-8de2-347999440e3e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.171849 Aug 24 16:12:08.728791 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1860/3762] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:08 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:08.734002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-d6caf2ea-5603-408d-a097-8e8e40bfbcff req-820b2c9d-ebd9-44d5-8ba6-6185462ba136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418de9ef-d5ca-47f7-95db-e7b136f7bae2", "name": "network-vif-plugged", "status": "completed", "tag": "8e5d2b1b-a116-4948-a8c8-cfcf76c01372"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:12:08.739731 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=14 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:08.745327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-d6caf2ea-5603-408d-a097-8e8e40bfbcff req-820b2c9d-ebd9-44d5-8ba6-6185462ba136 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:08.745808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-d6caf2ea-5603-408d-a097-8e8e40bfbcff req-820b2c9d-ebd9-44d5-8ba6-6185462ba136 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:08.746238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-d6caf2ea-5603-408d-a097-8e8e40bfbcff req-820b2c9d-ebd9-44d5-8ba6-6185462ba136 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:08.757676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-d6caf2ea-5603-408d-a097-8e8e40bfbcff req-820b2c9d-ebd9-44d5-8ba6-6185462ba136 service nova] Creating event network-vif-plugged:8e5d2b1b-a116-4948-a8c8-cfcf76c01372 for instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 on hv-cinder-84932 Aug 24 16:12:08.762600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-d6caf2ea-5603-408d-a097-8e8e40bfbcff req-820b2c9d-ebd9-44d5-8ba6-6185462ba136 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Aug 24 16:12:08.763182 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1903/3763] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:12:09.064715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:09.065252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:09.071181 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:09.071697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:09.072137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:09.072857 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:09.073310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:09.073738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:09.203123 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:09.211597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7491f8f8-4b91-4dd6-9191-e5f55957871b tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.150806 Aug 24 16:12:09.212199 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1861/3764] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:09 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:09.753202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:09.753911 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:09.760272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:09.760704 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:09.761145 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:09.761840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:09.762300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:09.762725 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:09.897676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:09.905332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-73e596a0-7f1e-4903-9125-5bd7d9748b52 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1371 microversion: 2.1 time: 0.157615 Aug 24 16:12:09.905904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1904/3765] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:09 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:10.234766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:10.235373 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:10.241932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:10.242404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:10.242833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:10.243513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:10.244004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:10.244423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:10.248253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=100 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:10.382207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:10.391585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e517b513-e295-4537-97f3-a50946c5d0de tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.161479 Aug 24 16:12:10.392280 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1862/3766] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:10 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:10.926497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:10.927115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:10.933117 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:10.933605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:10.934047 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:10.934741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:10.935200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:10.935645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:11.083350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:11.091003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b0fb5281-d83d-41ef-be70-1f8b26a164b0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1561 microversion: 2.1 time: 0.168621 Aug 24 16:12:11.091569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1905/3767] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:10 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:11.111070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:11.111497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:11.117447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:11.117930 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:11.118367 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:11.119052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:11.119603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:11.119975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:11.198438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3580704a-f216-4c77-b767-7e467dd5eb6b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091336 Aug 24 16:12:11.199028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1863/3768] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 16:12:11 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:12:11.413626 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:11.414231 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:11.420266 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:11.421246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:11.421684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:11.422404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:11.422917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:11.423341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:11.931607 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:11.939917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7b5199c1-cc2e-49a9-a8e3-7e7b95f1af68 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.530133 Aug 24 16:12:11.940499 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1906/3769] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:11 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:12.435408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-d54be177-8c76-4163-b2c2-5ad8c0a48f18 req-fa6f525b-8d10-4abb-a493-6c73df9b0708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418de9ef-d5ca-47f7-95db-e7b136f7bae2", "tag": "8e5d2b1b-a116-4948-a8c8-cfcf76c01372"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:12:12.446204 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-d54be177-8c76-4163-b2c2-5ad8c0a48f18 req-fa6f525b-8d10-4abb-a493-6c73df9b0708 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:12.446755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-d54be177-8c76-4163-b2c2-5ad8c0a48f18 req-fa6f525b-8d10-4abb-a493-6c73df9b0708 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:12.447190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-d54be177-8c76-4163-b2c2-5ad8c0a48f18 req-fa6f525b-8d10-4abb-a493-6c73df9b0708 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:12.460587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-d54be177-8c76-4163-b2c2-5ad8c0a48f18 req-fa6f525b-8d10-4abb-a493-6c73df9b0708 service nova] Creating event network-changed:8e5d2b1b-a116-4948-a8c8-cfcf76c01372 for instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 on hv-cinder-84932 Aug 24 16:12:12.465875 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-d54be177-8c76-4163-b2c2-5ad8c0a48f18 req-fa6f525b-8d10-4abb-a493-6c73df9b0708 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034738 Aug 24 16:12:12.466505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1864/3770] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:12:12.960971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:12.961595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:12.968389 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:12.968993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:12.969660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:12.970453 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:12.971125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:12.971658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:13.119989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:13.129620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f2f884b3-48d5-4643-b378-445cf4ca11e4 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.172896 Aug 24 16:12:13.130205 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1907/3771] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:12 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:14.153097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:14.153789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:14.160846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:14.161336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:14.161808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:14.162528 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:14.163010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:14.163431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:14.297040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:14.305323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d72838bb-00ce-4499-bacb-1d76873b9422 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.157096 Aug 24 16:12:14.306087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1865/3772] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:14 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:15.326309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:15.327037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:15.334238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:15.334718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:15.335156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:15.335885 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:15.336346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:15.336775 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:15.470016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:15.479033 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2ab24acf-054e-48d5-bb51-a5c163f1b7f7 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.156458 Aug 24 16:12:15.479740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1908/3773] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:15 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:16.501061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:16.501673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:16.508296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:16.508778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:16.509251 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:16.509973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:16.510422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:16.510844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:16.646742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:16.655721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-14bfca68-e533-477a-bbda-e8ddb4c2c60a tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.157867 Aug 24 16:12:16.656295 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1866/3774] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:16 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:17.676979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:17.677643 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:17.684213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:17.684701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:17.685142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:17.686337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:17.686872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:17.687306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:17.814519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:17.822815 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6c1baca7-fca7-4a5b-ac0c-231df35fc4fd tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.149690 Aug 24 16:12:17.823384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1909/3775] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:17 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:18.845657 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:18.846198 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:18.852805 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:18.853296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:18.853730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:18.854428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:18.854883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:18.855307 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:18.992332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:19.001115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cb9c716b-fa14-4577-a38b-85dca8476454 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.159604 Aug 24 16:12:19.001682 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1867/3776] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:18 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:20.022201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:20.022818 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:20.030012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:20.031187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:20.031652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:20.032360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:20.032825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:20.033261 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:20.168204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:20.176908 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d2e1b04a-9fa4-466d-826e-6bb12d415f38 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.158610 Aug 24 16:12:20.177474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1910/3777] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:20 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:21.198407 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:21.199012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:21.205494 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:21.205977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:21.206409 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:21.207101 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:21.207552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:21.208009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:21.336303 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:21.345083 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-86db0d30-9993-41be-b841-d79dfd0e0a2c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.150582 Aug 24 16:12:21.345653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1868/3778] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:21 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:22.365865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:22.366479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:22.373053 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:22.373560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:22.373992 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:22.374696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:22.375466 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:22.375571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:22.510319 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:22.519947 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1881397a-c5c0-40dd-a522-0c93e803ebfa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.157911 Aug 24 16:12:22.520526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1911/3779] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:22 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:23.541638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:23.542250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:23.549721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:23.550205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:23.550630 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:23.551324 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:23.551820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:23.552243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:23.681410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:23.689507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7189226d-2fc4-4f1d-a3db-87208d475872 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.151687 Aug 24 16:12:23.690080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1869/3780] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:23 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:24.710647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:24.711257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:24.717720 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:24.718209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:24.718649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:24.720418 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:24.720895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:24.721356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:24.851322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:24.859454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5c38f44f-8bff-4778-9b2f-270075d04883 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152924 Aug 24 16:12:24.860691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1912/3781] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:24 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:25.881967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:25.882581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:25.889134 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:25.889620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:25.890054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:25.890755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:25.891233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:25.891757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:26.024674 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:26.033169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-161f0405-1557-4bb6-9603-547c409be8c6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.155095 Aug 24 16:12:26.033741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1870/3782] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:25 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:27.054236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:27.054876 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:27.061303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:27.061776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:27.062209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:27.062895 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:27.063351 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:27.063976 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:27.194539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:27.203308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f156986b-1535-4b51-b4ff-362ecd2993f9 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152904 Aug 24 16:12:27.204101 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1913/3783] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:27 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:28.224986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:28.225700 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:28.232235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:28.232723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:28.233270 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:28.233980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:28.234437 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:28.235387 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:28.366887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:28.376738 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d04fbc15-48bd-4b1b-a5b8-302c448caf46 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154706 Aug 24 16:12:28.377692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1871/3784] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:28 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:29.398646 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:29.399258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:29.401856 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=40 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:29.407805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:29.408435 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:29.409082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:29.409849 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:29.410338 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:29.410770 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:29.545892 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:29.554496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-45265b49-3125-4218-a9e3-a823fedb29aa tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.159756 Aug 24 16:12:29.555062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1914/3785] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:29 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:30.576703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:30.577557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:30.585728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:30.586210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:30.586645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:30.587340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:30.588013 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:30.589372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:30.739151 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:30.748841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b26cb5b0-d18b-4c58-8572-3dbac077e614 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.176573 Aug 24 16:12:30.749434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1872/3786] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:30 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:31.773977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:31.774583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:31.781090 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:31.781572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:31.782012 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:31.782727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:31.783206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:31.783649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:31.916682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:31.926640 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e8b1b603-f428-4eac-8230-6684d10a190d tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.156445 Aug 24 16:12:31.927225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1915/3787] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:31 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:32.949009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:32.949621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:32.952033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=40 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:32.957814 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:32.958299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:32.958998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:32.959692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:32.960143 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:32.960561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:33.096656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:33.107047 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a987054a-ca38-4ece-af9c-c80b61e71ff2 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.161791 Aug 24 16:12:33.107552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1873/3788] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:32 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:34.129624 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:34.130271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:34.136762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:34.137253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:34.137692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:34.138386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:34.138845 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:34.139271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:34.270473 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:34.273894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=100 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:34.279658 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e2519826-f2c2-4485-a64d-a32c0900e19c tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154706 Aug 24 16:12:34.280237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1916/3789] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:34 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:35.300538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:35.301156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:35.307611 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:35.308127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:35.308560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:35.309252 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:35.309778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:35.310207 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:35.439884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:35.448507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c2d3369d-7b27-4908-bade-d1a2a2761484 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.152442 Aug 24 16:12:35.449084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1874/3790] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:35 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:36.471272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:36.471917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:36.478301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:36.478779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:36.479214 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:36.479920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:36.480377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:36.480800 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:36.617678 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:36.625786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d77ed51-45dd-4103-9056-a70c98867480 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.159287 Aug 24 16:12:36.626348 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1917/3791] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:36 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:12:37.646901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:37.647562 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:37.654103 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:37.654582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:37.655014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:37.655729 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:37.656183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:37.656609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:37.790276 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:37.803588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fc5fc034-5436-4645-a59b-edd69459f5bf tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.160434 Aug 24 16:12:37.804213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1875/3792] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:37 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:38.826174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:38.826773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:38.833369 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:38.834097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:38.834526 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:38.835213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:38.835682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:38.836130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:38.968875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:38.977575 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a87e77f6-53eb-4f25-a359-6364f6b4e349 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.155238 Aug 24 16:12:38.978150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1918/3793] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:38 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:39.999253 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:39.999813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:40.006846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:40.007322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:40.007796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:40.008478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:40.008923 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:40.009345 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:40.140717 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:40.149559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fd72613c-0b6d-4967-bcbb-723e3f8728e5 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.154336 Aug 24 16:12:40.150132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1876/3794] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:39 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:41.171306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:41.171963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:41.178651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:41.179229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:41.179577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:41.180304 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:41.180763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:41.181187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:41.320718 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:41.329969 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b1caf6eb-1cc6-4bc3-ae53-f598a3f8de73 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.161851 Aug 24 16:12:41.330997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1919/3795] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:41 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:42.352173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:42.352788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:42.358769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:42.359255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:42.359723 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:42.360794 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:42.361451 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:42.361879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:42.365745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=83 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:12:42.500379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:42.508680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d0a38b04-38b7-4f5c-a692-0d9073b6e211 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.160673 Aug 24 16:12:42.509245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1877/3796] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:42 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:43.530257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:43.530865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:43.537904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:43.538388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:43.538822 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:43.539508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:43.539994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:43.540419 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:43.670211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:43.679698 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e4e11694-bd79-4d60-ba47-a88e920b1cc6 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.153406 Aug 24 16:12:43.680272 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1920/3797] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:43 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:44.701371 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:44.702012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] [instance: 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:44.709369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:44.709860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:44.710301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:44.711003 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:44.711462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:44.711927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:44.842438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb26df0d1b82462bb494bd96dba4cf63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d926b1275d40fc9b26912ea4bbca02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:12:44.850970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1b7e8796-80ef-49e3-ad1d-1525f0348a36 tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1" status: 200 len: 1605 microversion: 2.1 time: 0.153411 Aug 24 16:12:44.851549 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1878/3798] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:12:44 2022] GET /compute/v2.1/servers/729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:12:44.871287 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3c95caf8-12ab-4caa-a807-d2895ac548ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] Calling method '.version_select at 0x7fc5d1205700>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:44.890881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3c95caf8-12ab-4caa-a807-d2895ac548ed tempest-TestMinimumBasicScenario-2129160771 tempest-TestMinimumBasicScenario-2129160771-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1584410968" status: 202 len: 0 microversion: 2.1 time: 0.023261 Aug 24 16:12:44.891570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1921/3799] 10.222.0.102 () {58 vars in 1277 bytes} [Wed Aug 24 16:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1584410968 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:12:47.387840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-96b31d1a-6277-4f34-8dd8-57dceeb91655 req-38d42cdc-1e08-4f26-8c31-a911ca17b05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a234e501-bc78-49d3-840c-65ec61718cc0", "name": "network-vif-deleted", "tag": "964ad286-e8b3-4ae1-bbea-f1b129ebb9ee"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:12:47.399301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-96b31d1a-6277-4f34-8dd8-57dceeb91655 req-38d42cdc-1e08-4f26-8c31-a911ca17b05c service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:47.400042 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-96b31d1a-6277-4f34-8dd8-57dceeb91655 req-38d42cdc-1e08-4f26-8c31-a911ca17b05c service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:47.400489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-96b31d1a-6277-4f34-8dd8-57dceeb91655 req-38d42cdc-1e08-4f26-8c31-a911ca17b05c service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:47.413386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-96b31d1a-6277-4f34-8dd8-57dceeb91655 req-38d42cdc-1e08-4f26-8c31-a911ca17b05c service nova] Creating event network-vif-deleted:964ad286-e8b3-4ae1-bbea-f1b129ebb9ee for instance a234e501-bc78-49d3-840c-65ec61718cc0 on hv-cinder-84932 Aug 24 16:12:47.418824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-96b31d1a-6277-4f34-8dd8-57dceeb91655 req-38d42cdc-1e08-4f26-8c31-a911ca17b05c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034683 Aug 24 16:12:47.419431 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1879/3800] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:12:50.533611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:12:50.538763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:12:50.544928 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:50.545427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:50.545866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:50.546563 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:12:50.547024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:12:50.547454 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:12:50.573206 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bd564a8f-435d-4987-aa28-0bdf4bd88c11 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2/ips" status: 200 len: 149 microversion: 2.1 time: 0.044777 Aug 24 16:12:50.573789 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1922/3801] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 16:12:50 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:13:50.672077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=13 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:50.672821 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=13 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:50.785485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:50.786594 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:50.793104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:50.793586 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:50.794025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:50.794708 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:50.795157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:50.795574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:50.821663 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Going to try to terminate instance {{(pid=132518) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:13:50.897300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9d550377-ea66-469f-820d-7210ef79136e tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 204 len: 0 microversion: 2.1 time: 0.227154 Aug 24 16:13:50.901394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1880/3802] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:13:50 2022] DELETE /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:13:50.904469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:50.905227 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=28 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:13:50.909487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:50.910103 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:50.923298 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:50.923756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:50.924197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:50.924906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:50.925367 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:50.925798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:51.183303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:13:51.191083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8eac2ed9-30da-4539-b744-43b16cd92c6f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1685 microversion: 2.1 time: 0.288296 Aug 24 16:13:51.191687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1923/3803] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:50 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1685 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:13:52.214051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:52.214751 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:52.221640 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:52.222125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:52.222564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:52.223839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:52.224360 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:52.224793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:52.408812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:13:52.417210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ffda4ddf-6399-4877-8728-a4a3cc615f48 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1685 microversion: 2.1 time: 0.207659 Aug 24 16:13:52.417786 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1881/3804] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:52 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:13:53.438490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:53.439008 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:53.446347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:53.446840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:53.447278 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:53.448006 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:53.448460 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:53.448887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:53.515998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:13:53.525529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-875d436b-775b-4d3b-92ff-0039dbc8d3c2 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 200 len: 1618 microversion: 2.1 time: 0.090958 Aug 24 16:13:53.526112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1924/3805] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:53 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 1618 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:13:53.632366 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-908683ec-41d7-46f9-aa59-fb3f2d21c85d req-144e4b75-aeb2-423b-ba0d-907263eab68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418de9ef-d5ca-47f7-95db-e7b136f7bae2", "name": "network-vif-deleted", "tag": "8e5d2b1b-a116-4948-a8c8-cfcf76c01372"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:13:53.643171 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-908683ec-41d7-46f9-aa59-fb3f2d21c85d req-144e4b75-aeb2-423b-ba0d-907263eab68b service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:53.643765 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-908683ec-41d7-46f9-aa59-fb3f2d21c85d req-144e4b75-aeb2-423b-ba0d-907263eab68b service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:53.644105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-908683ec-41d7-46f9-aa59-fb3f2d21c85d req-144e4b75-aeb2-423b-ba0d-907263eab68b service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:53.656180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-908683ec-41d7-46f9-aa59-fb3f2d21c85d req-144e4b75-aeb2-423b-ba0d-907263eab68b service nova] Creating event network-vif-deleted:8e5d2b1b-a116-4948-a8c8-cfcf76c01372 for instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 on hv-cinder-84932 Aug 24 16:13:53.663093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-908683ec-41d7-46f9-aa59-fb3f2d21c85d req-144e4b75-aeb2-423b-ba0d-907263eab68b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Aug 24 16:13:53.664078 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1882/3806] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:13:54.547002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:54.547648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:54.554917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:54.555413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:54.555897 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:54.556645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:54.557108 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:54.557536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:54.572323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 HTTP/1.1 Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:13:54.574005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:13:54.575204 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '418de9ef-d5ca-47f7-95db-e7b136f7bae2'} Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:13:54.575886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:13:54.576879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:13:54.577839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:13:54.577839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-14b79f4c-cca1-47b3-8f4f-c371cadc6ad7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 404 len: 111 microversion: 2.1 time: 0.032363 Aug 24 16:13:54.577839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1925/3807] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:54 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:13:54.586200 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c9f1128b-ec84-412a-a2e4-e99790ab61bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '.version_select at 0x7fc5cd3ddee0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:54.605973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c9f1128b-ec84-412a-a2e4-e99790ab61bc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422605883" status: 202 len: 0 microversion: 2.1 time: 0.025217 Aug 24 16:13:54.607004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1883/3808] 10.222.0.102 () {58 vars in 1226 bytes} [Wed Aug 24 16:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422605883 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:13:55.253286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6b867987-cb4c-41c3-8ab5-44bf0f38a695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: .version_select at 0x7fc5cc716dc0>, body: {"keypair": {"name": "tempest-keypair-1514806058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Tfy9usUDccaE22y0yO+muY8DQDuQrQ9bcqfwrYJVPySoygssBLxtG2C3TSAmvRnJD/KWINNdiL1+T+fH4zvlIAA4wZ+kVY1jtVbiF/we1Fkmm/aOSeBJLAJlJq1zhRA=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:13:55.268531 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-6b867987-cb4c-41c3-8ab5-44bf0f38a695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:13:55.272697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-6b867987-cb4c-41c3-8ab5-44bf0f38a695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:13:55.294866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6b867987-cb4c-41c3-8ab5-44bf0f38a695 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045486 Aug 24 16:13:55.295455 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1926/3809] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 16:13:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:13:56.512025 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1592696372", "imageRef": "e6226501-4291-485c-9c63-48b00aab1d52", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "865ac09d-5307-48a3-bc8a-ec402499204e"}], "security_groups": [{"name": "tempest-securitygroup--778749708"}], "key_name": "tempest-keypair-1514806058", "user_data": "}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:13:56.617913 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] validate_networks() for [('865ac09d-5307-48a3-bc8a-ec402499204e', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:13:56.991453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:13:56.991973 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:13:56.992473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:13:56.992891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:13:56.993316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:13:57.003532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:57.004137 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:57.004645 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:57.005443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:57.005967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:57.007104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:57.024168 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:13:57.028073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Getting quotas for user ee49fabdcd304c72afefa48a25644bae and project f7f37ef7959d4674acca179a4797e272. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:13:57.039659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:13:57.042063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6226501-4291-485c-9c63-48b00aab1d52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:13:57.092507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f6a9a6c0-adf3-4dd1-b80c-2964379c1607 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.584797 Aug 24 16:13:57.093160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1884/3810] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 16:13:56 2022] POST /compute/v2.1/servers => generated 403 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 16:13:57.107216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d89f26ec-389a-4fd9-906a-c743e4e01da6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:57.108063 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d89f26ec-389a-4fd9-906a-c743e4e01da6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:57.167488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d89f26ec-389a-4fd9-906a-c743e4e01da6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:13:57.174508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d89f26ec-389a-4fd9-906a-c743e4e01da6 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1246 microversion: 2.1 time: 0.073314 Aug 24 16:13:57.175080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1927/3811] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:57 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:13:58.196410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:58.197090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:58.203960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:58.204624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:58.205076 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:58.205782 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:58.207612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:58.208089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:58.280231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:13:58.288745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-647059ee-522f-4de2-9f9d-11ca8cb314e8 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1316 microversion: 2.1 time: 0.097053 Aug 24 16:13:58.289322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1885/3812] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:58 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1316 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:13:59.309738 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:13:59.310271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:13:59.316735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:59.317228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:59.317660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:59.318353 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:59.319570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:59.320174 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:59.460016 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:13:59.469513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2ccb3a61-637f-4dd5-a2ac-b95d84d98c78 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.163728 Aug 24 16:13:59.472154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-9d62ec28-cbbd-4702-a5ad-707761359955 req-5114c446-8dab-48ad-b868-dd52b98d20d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e765892-6177-40f2-955a-2cc75edeccb4", "tag": "20e768cf-e713-46b9-837d-aec17ba1f0a8"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:13:59.475683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1928/3813] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:13:59 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:13:59.490110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-9d62ec28-cbbd-4702-a5ad-707761359955 req-5114c446-8dab-48ad-b868-dd52b98d20d4 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:13:59.491145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-9d62ec28-cbbd-4702-a5ad-707761359955 req-5114c446-8dab-48ad-b868-dd52b98d20d4 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:13:59.491574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-9d62ec28-cbbd-4702-a5ad-707761359955 req-5114c446-8dab-48ad-b868-dd52b98d20d4 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:13:59.508697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-9d62ec28-cbbd-4702-a5ad-707761359955 req-5114c446-8dab-48ad-b868-dd52b98d20d4 service nova] Creating event network-changed:20e768cf-e713-46b9-837d-aec17ba1f0a8 for instance 1e765892-6177-40f2-955a-2cc75edeccb4 on hv-cinder-84932 Aug 24 16:13:59.514618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-9d62ec28-cbbd-4702-a5ad-707761359955 req-5114c446-8dab-48ad-b868-dd52b98d20d4 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047966 Aug 24 16:13:59.515221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1886/3814] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:14:00.490503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:00.491603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:00.498480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:00.498967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:00.499403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:00.500140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:00.500605 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:00.501035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:00.634755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:00.642480 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0f2094e-7822-4767-944b-1ae90bd3ad62 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.155881 Aug 24 16:14:00.643039 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1929/3815] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:00 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:01.665411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:01.666109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:01.672264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:01.672741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:01.673176 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:01.673861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:01.674311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:01.674734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:01.810118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:01.817616 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-81fd9385-b7e4-4caf-a86b-fffc91fa2819 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.157777 Aug 24 16:14:01.818173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1887/3816] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:01 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:02.839981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:02.840721 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:02.846776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:02.847701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:02.847701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:02.848395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:02.848854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:02.849281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:02.977743 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:02.985384 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-79a65a0e-70fb-49e4-b16d-84ccd8596e31 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.150946 Aug 24 16:14:02.985951 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1930/3817] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:02 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:04.007266 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:04.007858 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:04.014313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:04.014792 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:04.015225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:04.015939 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:04.016392 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:04.016813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:04.152433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:04.159988 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-527e824f-3bc6-41fc-8d68-a11ee4e418f7 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.157258 Aug 24 16:14:04.160546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1888/3818] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:04 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:05.185027 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:05.186525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:05.193321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:05.194449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:05.194958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:05.195620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:05.196096 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:05.196519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:05.284428 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-c6f506df-0fc3-4099-a287-2a7b3cd07cc1 req-6eba71f5-1ba2-4018-aeb3-cbe2060a2007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e765892-6177-40f2-955a-2cc75edeccb4", "name": "network-vif-plugged", "status": "completed", "tag": "20e768cf-e713-46b9-837d-aec17ba1f0a8"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:14:05.294914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c6f506df-0fc3-4099-a287-2a7b3cd07cc1 req-6eba71f5-1ba2-4018-aeb3-cbe2060a2007 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:05.295396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c6f506df-0fc3-4099-a287-2a7b3cd07cc1 req-6eba71f5-1ba2-4018-aeb3-cbe2060a2007 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:05.295852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c6f506df-0fc3-4099-a287-2a7b3cd07cc1 req-6eba71f5-1ba2-4018-aeb3-cbe2060a2007 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:05.309812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-c6f506df-0fc3-4099-a287-2a7b3cd07cc1 req-6eba71f5-1ba2-4018-aeb3-cbe2060a2007 service nova] Creating event network-vif-plugged:20e768cf-e713-46b9-837d-aec17ba1f0a8 for instance 1e765892-6177-40f2-955a-2cc75edeccb4 on hv-cinder-84932 Aug 24 16:14:05.314802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-c6f506df-0fc3-4099-a287-2a7b3cd07cc1 req-6eba71f5-1ba2-4018-aeb3-cbe2060a2007 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034924 Aug 24 16:14:05.315813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1889/3819] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:14:05.342972 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:05.353385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8d0a2303-b2f4-4579-bd59-16a1fd8d9f94 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.177031 Aug 24 16:14:05.354171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1931/3820] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:05 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:06.375340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:06.376094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:06.382758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:06.383246 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:06.383716 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:06.384410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:06.384864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:06.385289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:06.521718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:06.531059 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2b7bb7ae-2194-46ee-930e-467e124333d1 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1371 microversion: 2.1 time: 0.160288 Aug 24 16:14:06.531648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1890/3821] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:06 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:07.552529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:07.553238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:07.555766 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:07.561474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:07.561959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:07.562392 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:07.563082 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:07.563534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:07.563983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:07.704040 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:14:07.712151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f589cd7f-7cfd-4eef-8738-bc67b66fca2a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1562 microversion: 2.1 time: 0.163361 Aug 24 16:14:07.712667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1932/3822] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:07 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:14:07.731820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:07.732325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:07.734255 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:07.735167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=6 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:07.742268 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:07.742694 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:07.743125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:07.743862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:07.744310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:07.744735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:07.821240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-771a1c96-50fb-453f-966c-e53eaf0faba3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093271 Aug 24 16:14:07.821840 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1891/3823] 10.222.0.102 () {58 vars in 1280 bytes} [Wed Aug 24 16:14:07 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:14:08.981728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-19dd3493-16eb-4562-915b-00a45781582b req-4278846f-8db9-48c2-9463-08f4cc5010f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e765892-6177-40f2-955a-2cc75edeccb4", "tag": "20e768cf-e713-46b9-837d-aec17ba1f0a8"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:14:08.992228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-19dd3493-16eb-4562-915b-00a45781582b req-4278846f-8db9-48c2-9463-08f4cc5010f5 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:08.992798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-19dd3493-16eb-4562-915b-00a45781582b req-4278846f-8db9-48c2-9463-08f4cc5010f5 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:08.993364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-19dd3493-16eb-4562-915b-00a45781582b req-4278846f-8db9-48c2-9463-08f4cc5010f5 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:09.004627 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-19dd3493-16eb-4562-915b-00a45781582b req-4278846f-8db9-48c2-9463-08f4cc5010f5 service nova] Creating event network-changed:20e768cf-e713-46b9-837d-aec17ba1f0a8 for instance 1e765892-6177-40f2-955a-2cc75edeccb4 on hv-cinder-84932 Aug 24 16:14:09.010383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-19dd3493-16eb-4562-915b-00a45781582b req-4278846f-8db9-48c2-9463-08f4cc5010f5 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 Aug 24 16:14:09.010975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1933/3824] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:14:44.969227 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:44.970079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:44.974460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:44.974949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:44.983007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:44.983488 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:44.983956 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:44.984646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:44.985098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:44.985527 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:45.012212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-36cc8c30-e246-4320-bcfe-24b0432ed875 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4/ips" status: 200 len: 150 microversion: 2.1 time: 0.044262 Aug 24 16:14:45.012784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1892/3825] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 16:14:44 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:14:46.141290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:46.141961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:46.144805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:46.145589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=46 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:14:46.152711 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:46.153324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:46.153771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:46.154477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:46.154929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:46.155376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:46.173051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] HTTP exception thrown: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Request method failure captured: Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 HTTP/1.1 Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf2xh-C1tFdiRt6FNZ5-FZgYhUh1suuo-ZiAQtKZc9vdNUJNh-ykM8-K9i9E8UsDkqPFnCLky4sQfFcRW5j83MuyvXMSfyH8Tq5arIZcIjWG6m3_iN5vpOz046PZgiKoAyLivIA4mPmk0t3vSMIi755nXyEP4OlpP5jAa7IjSAE8nc Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:14:46.174463 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 38f7d31cf0f541f58af7d3d850af6472 Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.175600 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '17f1a7c0-a412-40d4-9809-6cbc75cae9a2'} Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:14:46.176378 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.177909 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.179650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Returning 404 to user: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:14:46.179650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0969cc75-1df2-4afb-b0af-1856e259c493 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 404 len: 111 microversion: 2.1 time: 0.039295 Aug 24 16:14:46.179650 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1934/3826] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:14:46 2022] DELETE /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:14:46.184627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:14:46.185426 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] [instance: 17f1a7c0-a412-40d4-9809-6cbc75cae9a2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:14:46.191727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:46.192283 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:46.192787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:46.193668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:14:46.194704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:14:46.195186 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:14:46.208470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] HTTP exception thrown: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Request method failure captured: Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 HTTP/1.1 Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf2xh-C1tFdiRt6FNZ5-FZgYhUh1suuo-ZiAQtKZc9vdNUJNh-ykM8-K9i9E8UsDkqPFnCLky4sQfFcRW5j83MuyvXMSfyH8Tq5arIZcIjWG6m3_iN5vpOz046PZgiKoAyLivIA4mPmk0t3vSMIi755nXyEP4OlpP5jAa7IjSAE8nc Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:14:46.210798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/b3568d52e7dd45b58640c06eddc5ea44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: b3568d52e7dd45b58640c06eddc5ea44 Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206647015 Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 38f7d31cf0f541f58af7d3d850af6472 Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeTestJSON-206647015-project Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.212223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '17f1a7c0-a412-40d4-9809-6cbc75cae9a2'} Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:14:46.212822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. Aug 24 16:14:46.214040 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:14:46.215073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] Returning 404 to user: Instance 17f1a7c0-a412-40d4-9809-6cbc75cae9a2 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:14:46.215073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ebca0b1d-3c4b-4df6-be15-2a131ddb6199 tempest-AttachVolumeTestJSON-206647015 tempest-AttachVolumeTestJSON-206647015-project] 10.222.0.102 "GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2" status: 404 len: 111 microversion: 2.1 time: 0.031702 Aug 24 16:14:46.215073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1893/3827] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:14:46 2022] GET /compute/v2.1/servers/17f1a7c0-a412-40d4-9809-6cbc75cae9a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:16:53.614289 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:16:53.615022 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:16:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:17:03.468861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:17:03.469623 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:17:04.159917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:17:04.160157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:17:05.590739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:17:05.591445 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:17:21.823770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:17:21.824541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:17:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:17:53.036634 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f96a7a8-589f-4312-bbdc-41c3084b6ab9] AMQP server on 10.222.0.102:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 16:17:53.037162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:17:53.037986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:17:53.041741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:17:53.042236 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:17:53.050564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:53.051062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:53.051498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:53.052232 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:53.052688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:53.053114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:53.078525 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:17:53.162516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0875060f-52e0-412e-bb98-9a477e5bbaf1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 204 len: 0 microversion: 2.20 time: 0.127586 Aug 24 16:17:53.163533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1935/3828] 10.222.0.102 () {60 vars in 1285 bytes} [Wed Aug 24 16:17:53 2022] DELETE /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:17:53.171287 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [480ee428-0e0f-47ab-bedb-42753959cd8a] AMQP server on 10.222.0.102:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 16:17:53.172309 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=4 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:17:53.174195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=6 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:17:53.178859 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:17:53.179473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:17:53.186853 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:53.187334 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:53.187799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:53.188532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:53.188986 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:53.189408 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:53.330278 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:17:53.338500 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:17:53.340092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:17:53.341249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9ea196df-d539-45fb-a01f-d321b5d029c2 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1727 microversion: 2.20 time: 0.172604 Aug 24 16:17:53.341796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1894/3829] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:17:53 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:17:54.365132 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:17:54.365997 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:17:54.373756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:54.374243 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:54.374682 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:54.375377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:54.376662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:54.377099 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:54.384111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f96a7a8-589f-4312-bbdc-41c3084b6ab9] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 41632. Aug 24 16:17:54.446112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:17:54.455238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:17:54.456956 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c058b07c1e9e443ebacbf38b1f13e58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5c7713b8574a09b7af9ab97b5ecbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:17:54.458184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4620c0e4-57e2-4529-a5a8-037e6548d237 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 200 len: 1659 microversion: 2.20 time: 0.098000 Aug 24 16:17:54.458753 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1936/3830] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:17:54 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 1659 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:17:54.483039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] [480ee428-0e0f-47ab-bedb-42753959cd8a] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 41636. Aug 24 16:17:54.656759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-8d7be7fe-3b8d-468f-96f1-6c52d091d49f req-1b8421d4-ea6f-4c05-9e51-a70e544c20ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61cc3727-a031-4b16-befc-0397d485562d", "name": "network-vif-deleted", "tag": "023a7f78-4c2f-4100-9fe5-283d259c51b9"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:17:54.667615 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8d7be7fe-3b8d-468f-96f1-6c52d091d49f req-1b8421d4-ea6f-4c05-9e51-a70e544c20ff service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:54.668230 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8d7be7fe-3b8d-468f-96f1-6c52d091d49f req-1b8421d4-ea6f-4c05-9e51-a70e544c20ff service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:54.668759 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-8d7be7fe-3b8d-468f-96f1-6c52d091d49f req-1b8421d4-ea6f-4c05-9e51-a70e544c20ff service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:54.682218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-8d7be7fe-3b8d-468f-96f1-6c52d091d49f req-1b8421d4-ea6f-4c05-9e51-a70e544c20ff service nova] Creating event network-vif-deleted:023a7f78-4c2f-4100-9fe5-283d259c51b9 for instance 61cc3727-a031-4b16-befc-0397d485562d on hv-cinder-84932 Aug 24 16:17:54.690557 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-8d7be7fe-3b8d-468f-96f1-6c52d091d49f req-1b8421d4-ea6f-4c05-9e51-a70e544c20ff service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223529 Aug 24 16:17:54.691264 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1895/3831] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:17:55.484652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:17:55.485905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:17:55.492509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:55.493005 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:55.493441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:55.494140 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:17:55.494656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:17:55.495087 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:17:55.508660 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] HTTP exception thrown: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Request method failure captured: Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d HTTP/1.1 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf2_P-qDkWs3NtdhFEeh8ssSBYtGLLfhnly1aa_fkQGNk_WxOmxKJpQiR3yM0DQX6LVLC-Gt4U8nUIdlmel5Ubyw6mmS2FtU1am1KVIhNU7ajUgVMZX0Sy75aWRuOIgzhvop692omcMH9wkGIaOFT7AO-PB0zUvRqlYSqrPftVdCCI Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:17:55.510322 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: c058b07c1e9e443ebacbf38b1f13e58b Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:17:55.511810 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '61cc3727-a031-4b16-befc-0397d485562d'} Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:17:55.512556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:17:55.513817 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:17:55.514927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Returning 404 to user: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:17:55.514927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f8f15b8-c3fc-49de-b064-68800a3b7625 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 404 len: 111 microversion: 2.20 time: 0.031130 Aug 24 16:17:55.514927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1937/3832] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:17:55 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:17:55.521355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dfea1b1-8f74-4c56-a0f4-8e8aeeda5c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '.version_select at 0x7fc5cc850310>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:17:55.547028 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3dfea1b1-8f74-4c56-a0f4-8e8aeeda5c2c tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298517876" status: 204 len: 0 microversion: 2.20 time: 0.029866 Aug 24 16:17:55.548743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1896/3833] 10.222.0.102 () {60 vars in 1264 bytes} [Wed Aug 24 16:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298517876 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:20:23.477201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:20:23.477792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:20:24.168159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:20:24.168310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:20:25.600298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:20:25.600907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:20:41.832625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:20:41.833243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:20:49.539216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:20:49.539830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:21:54.094811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f96a7a8-589f-4312-bbdc-41c3084b6ab9] AMQP server on 10.222.0.102:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 16:21:54.095417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:54.096237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:54.100913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:21:54.101413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:21:54.109806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:54.110321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:54.110756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:54.111450 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:54.111996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:54.112446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:54.137981 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:21:54.214211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4bc497ed-1308-494a-9b7d-eac21978b71d tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 204 len: 0 microversion: 2.1 time: 0.121212 Aug 24 16:21:54.215037 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1938/3834] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:21:54 2022] DELETE /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:21:54.222034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [480ee428-0e0f-47ab-bedb-42753959cd8a] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:21:54.222620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=8 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:54.223286 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:21:54.229298 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:21:54.230032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:21:54.237479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:54.237970 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:54.238410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:54.239109 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:54.239564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:54.240116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:54.426394 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:21:54.434223 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f8548512-f99b-418b-9d6f-cb49b84fdf4b tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1686 microversion: 2.1 time: 0.214706 Aug 24 16:21:54.435812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1897/3835] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:21:54 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1686 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:21:55.456569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:21:55.457281 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:21:55.467294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f96a7a8-589f-4312-bbdc-41c3084b6ab9] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 41788. Aug 24 16:21:55.475194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:55.475517 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:55.476331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:55.477197 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:55.477794 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:55.478552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:55.485416 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-ea42ba35-7203-41ee-a793-bd9c0d61d12e req-1d127a99-bd3f-4d03-8f05-8380973c2620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e765892-6177-40f2-955a-2cc75edeccb4", "name": "network-vif-deleted", "tag": "20e768cf-e713-46b9-837d-aec17ba1f0a8"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:21:55.498968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ea42ba35-7203-41ee-a793-bd9c0d61d12e req-1d127a99-bd3f-4d03-8f05-8380973c2620 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:55.499721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ea42ba35-7203-41ee-a793-bd9c0d61d12e req-1d127a99-bd3f-4d03-8f05-8380973c2620 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:55.500370 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ea42ba35-7203-41ee-a793-bd9c0d61d12e req-1d127a99-bd3f-4d03-8f05-8380973c2620 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:55.513607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] [480ee428-0e0f-47ab-bedb-42753959cd8a] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 41792. Aug 24 16:21:55.516581 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-ea42ba35-7203-41ee-a793-bd9c0d61d12e req-1d127a99-bd3f-4d03-8f05-8380973c2620 service nova] Creating event network-vif-deleted:20e768cf-e713-46b9-837d-aec17ba1f0a8 for instance 1e765892-6177-40f2-955a-2cc75edeccb4 on hv-cinder-84932 Aug 24 16:21:55.523801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-ea42ba35-7203-41ee-a793-bd9c0d61d12e req-1d127a99-bd3f-4d03-8f05-8380973c2620 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041896 Aug 24 16:21:55.524819 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1898/3836] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:21:55.640310 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee49fabdcd304c72afefa48a25644bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f37ef7959d4674acca179a4797e272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:21:55.651469 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d35b767f-f458-4812-9b18-384a3c9a939a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 200 len: 1619 microversion: 2.1 time: 0.199057 Aug 24 16:21:55.652349 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1939/3837] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:21:55 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 1619 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:21:56.682865 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:21:56.683932 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:21:56.691049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:56.691538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:56.692008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:56.693202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:21:56.694318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:21:56.694754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:21:56.708132 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 HTTP/1.1 Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:21:56.710966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:21:56.712349 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '1e765892-6177-40f2-955a-2cc75edeccb4'} Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:21:56.713177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:21:56.714337 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:21:56.715532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:21:56.715532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6fc1bca8-6b3a-48ea-90c1-37651edd255f tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 404 len: 111 microversion: 2.1 time: 0.036127 Aug 24 16:21:56.715532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1899/3838] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:21:56 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:21:56.721742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c985a0fc-c11d-4db2-8322-5bd5602b938a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '.version_select at 0x7fc5cc751790>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:21:56.745971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c985a0fc-c11d-4db2-8322-5bd5602b938a tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514806058" status: 202 len: 0 microversion: 2.1 time: 0.028084 Aug 24 16:21:56.746560 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1940/3839] 10.222.0.102 () {58 vars in 1226 bytes} [Wed Aug 24 16:21:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514806058 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:22:38.642559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.643070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.645332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=6 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:22:38.646006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=10 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:22:38.652385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.652883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.654125 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.654841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.655301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.655768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.682762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Going to try to terminate instance {{(pid=132518) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:22:38.761202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4d7b5592-fb09-43b6-b852-63fd15403510 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "DELETE /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 204 len: 0 microversion: 2.1 time: 0.123167 Aug 24 16:22:38.761777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1900/3840] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:22:38 2022] DELETE /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:22:38.770111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.770780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.773007 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:22:38.773657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:22:38.784065 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.784566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.785011 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.785888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.786449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.786780 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.797452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.798035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.804146 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.804638 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.805080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.805798 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.806254 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.806743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.822580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 HTTP/1.1 Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:38.824582 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.826297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '1e765892-6177-40f2-955a-2cc75edeccb4'} Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:38.827088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.828411 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.830553 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:38.831606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3f7eb25d-3dbc-440a-acba-32fc471e50cc tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 404 len: 111 microversion: 2.1 time: 0.039058 Aug 24 16:22:38.832205 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1901/3841] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:22:38 2022] DELETE /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:22:38.841795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.842698 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 1e765892-6177-40f2-955a-2cc75edeccb4] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.849282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.849681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.850126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.850843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.851299 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.851757 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.867608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 HTTP/1.1 Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:38.869142 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.870285 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '1e765892-6177-40f2-955a-2cc75edeccb4'} Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:38.870887 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. Aug 24 16:22:38.873515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.874438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance 1e765892-6177-40f2-955a-2cc75edeccb4 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:38.874438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-705a2323-3387-46f9-b71f-a90522992ba0 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4" status: 404 len: 111 microversion: 2.1 time: 0.034129 Aug 24 16:22:38.874438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1902/3842] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:38 2022] GET /compute/v2.1/servers/1e765892-6177-40f2-955a-2cc75edeccb4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:22:38.880666 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.881170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.887833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.888385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.888830 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.889545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.889993 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.890425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.909160 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 HTTP/1.1 Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:38.910732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.912060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '418de9ef-d5ca-47f7-95db-e7b136f7bae2'} Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:38.912880 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.914075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.915049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:38.915049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-47b83eb1-4fe8-41d7-9ad8-9790f3f3b0c3 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 404 len: 111 microversion: 2.1 time: 0.035711 Aug 24 16:22:38.915049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1903/3843] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:22:38 2022] DELETE /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:22:38.927214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.927883 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: 418de9ef-d5ca-47f7-95db-e7b136f7bae2] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.934410 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.934914 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.935354 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.936104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.936559 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.936987 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.951439 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 HTTP/1.1 Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:38.953158 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '418de9ef-d5ca-47f7-95db-e7b136f7bae2'} Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:38.955124 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. Aug 24 16:22:38.956162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.957069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance 418de9ef-d5ca-47f7-95db-e7b136f7bae2 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:38.957069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-970aee53-220a-4962-93c6-0f48e8b2be18 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2" status: 404 len: 111 microversion: 2.1 time: 0.037024 Aug 24 16:22:38.957754 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1904/3844] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:38 2022] GET /compute/v2.1/servers/418de9ef-d5ca-47f7-95db-e7b136f7bae2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:22:38.963551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:38.964322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:38.971979 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.972467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.972906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.973609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:38.974068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:38.974490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:38.989491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af HTTP/1.1 Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:38.991069 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:38.992314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'c8140eb7-59b4-41da-821d-1dff940c68af'} Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:38.992931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:38.993941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:38.995079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:38.995079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3dc2d53a-198e-495f-a16d-45580b94f56c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 404 len: 111 microversion: 2.1 time: 0.032625 Aug 24 16:22:38.995079 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1905/3845] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:22:38 2022] DELETE /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:22:39.001369 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:39.001983 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: c8140eb7-59b4-41da-821d-1dff940c68af] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:39.007892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:39.008386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:39.008822 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:39.009523 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:39.009975 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:39.010422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:39.024637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af HTTP/1.1 Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:39.026170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:39.027464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'c8140eb7-59b4-41da-821d-1dff940c68af'} Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:39.028713 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. Aug 24 16:22:39.030732 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:39.032098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance c8140eb7-59b4-41da-821d-1dff940c68af could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:39.032098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-2faad892-36cd-4ddb-8c62-52c9eab33988 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af" status: 404 len: 111 microversion: 2.1 time: 0.030734 Aug 24 16:22:39.032098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1906/3846] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:38 2022] GET /compute/v2.1/servers/c8140eb7-59b4-41da-821d-1dff940c68af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:22:39.097687 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:39.105589 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-022dced5-d13c-4d07-9b8f-e6859bcb9165 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1513 microversion: 2.1 time: 0.339340 Aug 24 16:22:39.106155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1941/3847] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:38 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:22:40.127422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:40.127977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:40.134362 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:40.134842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:40.135279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:40.135989 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:40.136443 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:40.136868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:40.267539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:40.275347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dfcdb337-7c50-4857-a8e7-41fd9421c0eb tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1513 microversion: 2.1 time: 0.151869 Aug 24 16:22:40.275927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1907/3848] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:40 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:22:41.297301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:41.298944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:41.306878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:41.307669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:41.308342 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:41.310836 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:41.311655 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:41.312293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:41.472827 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:41.480539 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a0db51cb-d1ad-433a-8616-f1029f786c41 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1513 microversion: 2.1 time: 0.188224 Aug 24 16:22:41.481127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1942/3849] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:41 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:22:42.320982 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:42.321430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:42.328807 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.329532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.330167 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.330882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.331547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.332150 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.348471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 HTTP/1.1 Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:42.350425 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.351850 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'a234e501-bc78-49d3-840c-65ec61718cc0'} Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:42.352625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.353886 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.355879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:42.357688 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6d686170-90b7-46da-88cb-17b19af44379 tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 404 len: 111 microversion: 2.1 time: 0.041078 Aug 24 16:22:42.366483 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:42.367723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] [instance: a234e501-bc78-49d3-840c-65ec61718cc0] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:42.373415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1908/3850] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:22:42 2022] DELETE /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:22:42.375989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.376844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.377543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.378481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.379269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.379996 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.396089 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] HTTP exception thrown: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Request method failure captured: Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 HTTP/1.1 Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkhRDCA53qC9ZuSSUGW0jX51dLlgJGzmBnglobfJa1MXBhxoCLGmVbzB0aXjRpmrvpEjyzr6DtiaEtyiesLPKJJmOh9CsAyaxP42uEbv6lrB2ueEXbQAzmZJIL4WLMH4fWZFoV8EBLlSNgPd3ssbWLuJNipcI8bEFYB3zygg4lNEjSA Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:22:42.397787 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_f7f37ef7959d4674acca179a4797e272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/f7f37ef7959d4674acca179a4797e272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: f7f37ef7959d4674acca179a4797e272 Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838810761 Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: ee49fabdcd304c72afefa48a25644bae Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeNegativeTest-838810761-project Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.399201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'a234e501-bc78-49d3-840c-65ec61718cc0'} Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:42.400171 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. Aug 24 16:22:42.401376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:42.403388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] Returning 404 to user: Instance a234e501-bc78-49d3-840c-65ec61718cc0 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:42.404410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fddc187e-d2ce-452a-93b7-f5b8f09e6e8c tempest-AttachVolumeNegativeTest-838810761 tempest-AttachVolumeNegativeTest-838810761-project] 10.222.0.102 "GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0" status: 404 len: 111 microversion: 2.1 time: 0.041785 Aug 24 16:22:42.405175 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1943/3851] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:42 2022] GET /compute/v2.1/servers/a234e501-bc78-49d3-840c-65ec61718cc0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:22:42.503421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:42.504352 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:42.523842 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.532910 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.533631 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.536292 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.544595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.545505 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.726553 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-efb638e9-f3dd-434b-a9cb-634aa140a76c req-982d3e61-c5c3-4962-83cf-77df9ed2677c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e42f6c-3744-4979-9c73-20f918be2be6", "name": "network-vif-deleted", "tag": "fa46fbec-7c7c-41fc-8c49-ba0a30ead225"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:22:42.741927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-efb638e9-f3dd-434b-a9cb-634aa140a76c req-982d3e61-c5c3-4962-83cf-77df9ed2677c service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:42.745398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-efb638e9-f3dd-434b-a9cb-634aa140a76c req-982d3e61-c5c3-4962-83cf-77df9ed2677c service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:42.749358 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-efb638e9-f3dd-434b-a9cb-634aa140a76c req-982d3e61-c5c3-4962-83cf-77df9ed2677c service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:42.772590 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-efb638e9-f3dd-434b-a9cb-634aa140a76c req-982d3e61-c5c3-4962-83cf-77df9ed2677c service nova] Creating event network-vif-deleted:fa46fbec-7c7c-41fc-8c49-ba0a30ead225 for instance c5e42f6c-3744-4979-9c73-20f918be2be6 on hv-cinder-84932 Aug 24 16:22:42.805306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-efb638e9-f3dd-434b-a9cb-634aa140a76c req-982d3e61-c5c3-4962-83cf-77df9ed2677c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061279 Aug 24 16:22:42.807557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1944/3852] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:22:42.861901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:42.871926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6005ecfa-c217-4b28-82c8-f4e9461da7e5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1513 microversion: 2.1 time: 0.373162 Aug 24 16:22:42.886384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1909/3853] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:42 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1513 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:22:43.896896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:43.897598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:43.925478 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:43.925988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:43.927578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:43.928615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:43.930826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:43.932374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:44.035751 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:44.036844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:44.037535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:44.046801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lazy-loading 'fault' on Instance uuid 253aedec-4338-4cde-8059-862a76ca4202 {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:22:44.161042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:44.171522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c42c9918-cdcb-4848-8576-e3611da47fc8 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 200 len: 1316 microversion: 2.1 time: 0.280900 Aug 24 16:22:44.188784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1945/3854] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:43 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:22:44.833378 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "253aedec-4338-4cde-8059-862a76ca4202", "name": "network-vif-deleted", "tag": "3deb4c39-af46-406b-9dd9-8450fa0166df"}, {"server_uuid": "729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1", "name": "network-vif-deleted", "tag": "2d2bfb11-9546-4df1-9050-8f910b8ceba3"}, {"server_uuid": "f68e3c94-e105-482d-916a-1e70d8b64373", "name": "network-vif-deleted", "tag": "d1548f61-5ebc-49eb-937c-26c444647a7d"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:22:44.847712 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:44.849019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:44.849568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:44.863871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Creating event network-vif-deleted:3deb4c39-af46-406b-9dd9-8450fa0166df for instance 253aedec-4338-4cde-8059-862a76ca4202 on hv-cinder-84932 Aug 24 16:22:44.864509 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Creating event network-vif-deleted:2d2bfb11-9546-4df1-9050-8f910b8ceba3 for instance 729a92ed-e6a0-4e7f-9bf9-ac7f21860cc1 on hv-cinder-84932 Aug 24 16:22:44.865108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] Creating event network-vif-deleted:d1548f61-5ebc-49eb-937c-26c444647a7d for instance f68e3c94-e105-482d-916a-1e70d8b64373 on hv-cinder-84932 Aug 24 16:22:44.874072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-cb37baba-1f2c-43a8-812b-5df173287d4a req-44e29bbb-0739-4a30-847d-9dcd8a3d6443 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044592 Aug 24 16:22:44.874882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1910/3855] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:22:45.195234 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:45.197410 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 253aedec-4338-4cde-8059-862a76ca4202] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:45.210383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:45.211735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:45.212170 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:45.214529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:45.216282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:45.217861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:45.254179 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] HTTP exception thrown: Instance 253aedec-4338-4cde-8059-862a76ca4202 could not be found. Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Request method failure captured: Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 HTTP/1.1 Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkfwULJlZGKgX95heJf4zmfQ6lCot_jPsLm-uuJLOBYiTPd61Rpfd0r80qfrelDBVdp4_oRyr_KhacfwrVs7iJON0EExXBaJ12WgjncP4WQXgRdN9Qp4mwuq9HArNdls9ZOGzY3kTZ97wq-9MdyseP-yVzdtWRe3QQYdoDmWwCmTPsw Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:22:45.256535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: 2fe5724620da46ddbefbdfd442dc8d73 Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 253aedec-4338-4cde-8059-862a76ca4202 could not be found. Aug 24 16:22:45.257776 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '253aedec-4338-4cde-8059-862a76ca4202'} Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253aedec-4338-4cde-8059-862a76ca4202 could not be found. Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:45.258486 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253aedec-4338-4cde-8059-862a76ca4202 could not be found. Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253aedec-4338-4cde-8059-862a76ca4202 could not be found. Aug 24 16:22:45.259843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:22:45.261801 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Returning 404 to user: Instance 253aedec-4338-4cde-8059-862a76ca4202 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:45.262995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-30a744e7-a014-4927-803d-834b7eb79565 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202" status: 404 len: 111 microversion: 2.1 time: 0.072504 Aug 24 16:22:45.264062 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1946/3856] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:45 2022] GET /compute/v2.1/servers/253aedec-4338-4cde-8059-862a76ca4202 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:22:45.272675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:45.274095 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:45.282761 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:45.283233 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:45.283778 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:45.284931 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:45.285619 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:45.286038 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:45.320633 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Going to try to terminate instance {{(pid=132518) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:22:45.435265 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8b370d16-98fc-4d49-a4f5-b38d3379c0ca tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "DELETE /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 204 len: 0 microversion: 2.1 time: 0.165925 Aug 24 16:22:45.437585 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1911/3857] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:22:45 2022] DELETE /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:22:45.446312 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:45.447388 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:45.456200 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:45.457100 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:45.457790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:45.460059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:45.463365 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:45.463987 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:45.644416 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:45.655828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1233eca3-24e0-4d23-bec8-e75a569609e3 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1525 microversion: 2.1 time: 0.213815 Aug 24 16:22:45.658677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1947/3858] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:45 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1525 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:22:46.679968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:46.682086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:46.698055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:46.698589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:46.699039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:46.703504 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:46.704077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:46.706180 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:46.834515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe5724620da46ddbefbdfd442dc8d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe57b34d5144e91bafb66f54169cbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:22:46.858878 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4a6fec4a-b324-4030-b095-f32456c9edf4 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 200 len: 1483 microversion: 2.1 time: 0.183903 Aug 24 16:22:46.861513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1912/3859] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:46 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 1483 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:22:46.892391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-98b5f811-6fab-4d4c-9dc6-fcb7ccddae74 req-95e6a77c-dacf-4170-91af-8bd4d53103ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b76a210-7149-41db-9f03-84c996c8ee63", "name": "network-vif-deleted", "tag": "8c58563e-d765-4da9-a6dc-e72ac2dc33ab"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:22:46.907279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-98b5f811-6fab-4d4c-9dc6-fcb7ccddae74 req-95e6a77c-dacf-4170-91af-8bd4d53103ba service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:46.908156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-98b5f811-6fab-4d4c-9dc6-fcb7ccddae74 req-95e6a77c-dacf-4170-91af-8bd4d53103ba service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:46.908952 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-98b5f811-6fab-4d4c-9dc6-fcb7ccddae74 req-95e6a77c-dacf-4170-91af-8bd4d53103ba service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:46.927696 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-98b5f811-6fab-4d4c-9dc6-fcb7ccddae74 req-95e6a77c-dacf-4170-91af-8bd4d53103ba service nova] Creating event network-vif-deleted:8c58563e-d765-4da9-a6dc-e72ac2dc33ab for instance 3b76a210-7149-41db-9f03-84c996c8ee63 on hv-cinder-84932 Aug 24 16:22:46.932970 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-98b5f811-6fab-4d4c-9dc6-fcb7ccddae74 req-95e6a77c-dacf-4170-91af-8bd4d53103ba service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047318 Aug 24 16:22:46.933656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1948/3860] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:22:47.884768 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:22:47.885906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] [instance: 3b76a210-7149-41db-9f03-84c996c8ee63] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:22:47.893161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:47.893855 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:47.894447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:47.895301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:22:47.895927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:22:47.896502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:22:47.912404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] HTTP exception thrown: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 could not be found. Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Request method failure captured: Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 HTTP/1.1 Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkfwULJlZGKgX95heJf4zmfQ6lCot_jPsLm-uuJLOBYiTPd61Rpfd0r80qfrelDBVdp4_oRyr_KhacfwrVs7iJON0EExXBaJ12WgjncP4WQXgRdN9Qp4mwuq9HArNdls9ZOGzY3kTZ97wq-9MdyseP-yVzdtWRe3QQYdoDmWwCmTPsw Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:22:47.914569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/8fe57b34d5144e91bafb66f54169cbcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 8fe57b34d5144e91bafb66f54169cbcf Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-671119691 Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: 2fe5724620da46ddbefbdfd442dc8d73 Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-ServerRescueNegativeTestJSON-671119691-project Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 could not be found. Aug 24 16:22:47.915868 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '3b76a210-7149-41db-9f03-84c996c8ee63'} Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 could not be found. Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:22:47.916642 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 could not be found. Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 could not be found. Aug 24 16:22:47.917852 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:22:47.919710 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] Returning 404 to user: Instance 3b76a210-7149-41db-9f03-84c996c8ee63 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:22:47.920715 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-de781dd0-72bf-402b-bc28-c75212fcf7d5 tempest-ServerRescueNegativeTestJSON-671119691 tempest-ServerRescueNegativeTestJSON-671119691-project] 10.222.0.102 "GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63" status: 404 len: 111 microversion: 2.1 time: 0.040594 Aug 24 16:22:47.924489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1913/3861] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:22:47 2022] GET /compute/v2.1/servers/3b76a210-7149-41db-9f03-84c996c8ee63 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:23:11.336301 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=18 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:11.337644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=34 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:11.544165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8ba67d24-625e-4c57-9525-5bf32bc93492 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Action: 'create', calling method: .version_select at 0x7fc5cc704310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1077735100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5qlU7IsgL/D3gPR1fg9yoOLNzmDa8IQcTDT6PKXkF2Uckj74hvQgFja2EFZAl429uEPx1pL2Sy/qj1dTz4oNk1GEt8ox4fkB/lmggbcjJ5Hq6IJ9e+Bm1pE1eMVTIOrA=="}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:23:11.563586 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-8ba67d24-625e-4c57-9525-5bf32bc93492 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:23:11.567511 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-8ba67d24-625e-4c57-9525-5bf32bc93492 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for user fe64f798929444dd838825dc0d2700cf and project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'key_pairs'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:23:11.592730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8ba67d24-625e-4c57-9525-5bf32bc93492 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.262680 Aug 24 16:23:11.593324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1949/3862] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 16:23:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:23:33.626166 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:23:33.626769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:23:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:23:36.760341 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-866295989", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1077735100", "security_groups": [{"name": "tempest-secgroup-smoke-1436962510"}], "block_device_mapping_v2": [{"uuid": "c2964478-783e-418d-b3ea-3ec7a8cb542a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daf6163c-a505-4b53-a37d-44f3eecad956"}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:23:36.771127 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:36.771837 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:36.879239 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] validate_networks() for [('daf6163c-a505-4b53-a37d-44f3eecad956', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:23:37.380664 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:23:37.381188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:23:37.381725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:23:37.382175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:23:37.382597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:23:37.392229 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:37.392718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:37.393249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:37.393980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:37.394442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:37.394871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:37.411922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:23:37.415985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for user fe64f798929444dd838825dc0d2700cf and project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:23:37.474662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:23:37.476824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2964478-783e-418d-b3ea-3ec7a8cb542a',volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:23:37.631092 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [c665b8d4-679d-47d4-9782-40f3eab170d5] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:23:38.638918 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [c665b8d4-679d-47d4-9782-40f3eab170d5] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 43406. Aug 24 16:23:38.643087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-ba140b9a-6240-4e53-9737-76c1d362d864 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.887087 Aug 24 16:23:38.643758 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1914/3863] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 16:23:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 16:23:38.652015 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=4 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:38.653343 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:38.659002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0d5a182d-f974-4654-91cf-b7df679339bb tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:38.659983 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0d5a182d-f974-4654-91cf-b7df679339bb tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:38.721826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0d5a182d-f974-4654-91cf-b7df679339bb tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:38.729779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0d5a182d-f974-4654-91cf-b7df679339bb tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1097 microversion: 2.1 time: 0.079272 Aug 24 16:23:38.730347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1950/3864] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:38 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1097 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:39.756490 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-eb3c86fe-6dd3-4d00-895b-bf342725074f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:39.758029 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-eb3c86fe-6dd3-4d00-895b-bf342725074f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:39.827846 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-eb3c86fe-6dd3-4d00-895b-bf342725074f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:39.837502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-eb3c86fe-6dd3-4d00-895b-bf342725074f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1097 microversion: 2.1 time: 0.088166 Aug 24 16:23:39.838089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1915/3865] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:39 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1097 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:40.858313 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ed7ba5ef-32c0-4485-a5cb-dab754130b6a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:40.858926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ed7ba5ef-32c0-4485-a5cb-dab754130b6a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:40.920288 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ed7ba5ef-32c0-4485-a5cb-dab754130b6a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:40.929500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ed7ba5ef-32c0-4485-a5cb-dab754130b6a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1097 microversion: 2.1 time: 0.075650 Aug 24 16:23:40.930474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1951/3866] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:40 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1097 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:41.953427 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0e28d6a9-ddf7-46d8-bacb-89be9e0c7ab6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:41.954600 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0e28d6a9-ddf7-46d8-bacb-89be9e0c7ab6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:42.210234 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0e28d6a9-ddf7-46d8-bacb-89be9e0c7ab6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:42.222929 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0e28d6a9-ddf7-46d8-bacb-89be9e0c7ab6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1097 microversion: 2.1 time: 0.272209 Aug 24 16:23:42.225889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1916/3867] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:41 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1097 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:43.247828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:43.247828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:43.257121 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:43.257921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:43.258806 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:43.259979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:43.260472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:43.261071 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:43.332095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:43.341465 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e08acb75-e456-48a2-a32b-5b755b00fa5a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1147 microversion: 2.1 time: 0.099485 Aug 24 16:23:43.343710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1952/3868] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:43 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1147 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:43.485535 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:23:43.485710 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:23:44.365835 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:44.367065 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:44.377476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:44.379152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:44.380118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:44.381456 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:44.382995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:44.384404 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:44.476470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:44.486606 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9d4ed9b3-f930-44c7-8fd3-1e38d759f8cf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1213 microversion: 2.1 time: 0.125821 Aug 24 16:23:44.501073 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1917/3869] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:44 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:45.513558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:45.514914 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:45.523404 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:45.524703 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:45.525973 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:45.527901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:45.528667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:45.529680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:45.717824 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:45.729350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7dbf27b2-766b-40c6-8517-8c025e613c1e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.223996 Aug 24 16:23:45.730320 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1953/3870] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:45 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:46.278104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-bd5a6146-b330-4216-804e-6bb5a22662e2 req-aaf65d20-963e-446f-acc0-b97823537e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0be10b4-a90b-4509-8de1-a58f29f7b3d6", "tag": "746a11a9-951b-434d-8b77-58316be83e90"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:23:46.288636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-bd5a6146-b330-4216-804e-6bb5a22662e2 req-aaf65d20-963e-446f-acc0-b97823537e7d service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:46.289118 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-bd5a6146-b330-4216-804e-6bb5a22662e2 req-aaf65d20-963e-446f-acc0-b97823537e7d service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:46.289545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-bd5a6146-b330-4216-804e-6bb5a22662e2 req-aaf65d20-963e-446f-acc0-b97823537e7d service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:46.301908 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-bd5a6146-b330-4216-804e-6bb5a22662e2 req-aaf65d20-963e-446f-acc0-b97823537e7d service nova] Creating event network-changed:746a11a9-951b-434d-8b77-58316be83e90 for instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 on hv-cinder-84932 Aug 24 16:23:46.307245 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-bd5a6146-b330-4216-804e-6bb5a22662e2 req-aaf65d20-963e-446f-acc0-b97823537e7d service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318072 Aug 24 16:23:46.307870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1918/3871] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:23:46.754290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:46.756265 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:46.766999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:46.767707 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:46.768294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:46.768995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:46.769443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:46.769865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:46.940929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:46.949777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4cbf944e-5e6d-4934-8fdd-877fbe8feb25 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.201386 Aug 24 16:23:46.950566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1954/3872] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:46 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:47.968478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:47.972885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:47.973825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:47.981353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:47.981849 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:47.982294 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:47.982998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:47.983484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:47.983950 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:48.128250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:48.136597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-79b6c321-7d17-49eb-a64a-75ca2b85bfab tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.169426 Aug 24 16:23:48.138475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1919/3873] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:47 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:49.157377 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:49.158024 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:49.164479 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:49.164966 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:49.165440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:49.166135 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:49.166628 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:49.167055 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:49.305779 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:49.315187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6f465040-555c-486d-ba80-4c5d52edb202 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.161247 Aug 24 16:23:49.315740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1955/3874] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:49 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:50.341771 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:50.343937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:50.351742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:50.352610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:50.353213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:50.354099 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:50.354561 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:50.355114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:50.573111 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:50.582454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e2fabe73-97ae-49f3-ad07-ca01f21e9fb7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.248005 Aug 24 16:23:50.583035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1920/3875] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:50 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:51.603826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:51.604578 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:51.612305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=4 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:51.616533 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:51.617148 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:51.617734 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:51.618549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:51.619114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:51.619668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:51.781840 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:51.790953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9e5afef0-8e38-44b0-972c-392601150f3a tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.191002 Aug 24 16:23:51.791730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1956/3876] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:51 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:52.813194 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:52.813808 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:52.816140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=10 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:23:52.828288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:52.828961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:52.829568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:52.830282 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:52.831063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:52.831661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:53.030461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:53.047343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5f7f349e-81c3-440a-a475-aa4155d69228 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.237927 Aug 24 16:23:53.047952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1921/3877] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:52 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:54.068662 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:54.069305 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:54.077472 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:54.077965 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:54.078427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:54.079141 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:54.079863 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:54.080656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:54.223792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:54.231280 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a20e086e-75a2-45f5-9f8d-e9481d202e5e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.166616 Aug 24 16:23:54.231977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1957/3878] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:54 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:55.252535 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:55.253148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:55.259667 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:55.260175 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:55.260618 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:55.261323 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:55.261772 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:55.262197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:55.404052 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:55.411793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6d05a112-c8ef-461c-a75f-8f18c1289511 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.163273 Aug 24 16:23:55.412355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1922/3879] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:55 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:56.432350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:56.432985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:56.439045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:56.439524 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:56.439985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:56.440667 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:56.441114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:56.441530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:56.580509 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:56.588481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9c46dfdc-e0ae-4827-b95b-94007320277d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.160093 Aug 24 16:23:56.589456 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1958/3880] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:56 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:57.611893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:57.613212 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:57.620927 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:57.628838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:57.630331 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:57.631802 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:57.632587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:57.633156 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:57.803219 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:57.813911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-dc01a7e1-09f6-4762-a5f7-4dbbf1f7f8e6 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.207271 Aug 24 16:23:57.814383 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1923/3881] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:57 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:23:57.829545 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-b2ae801d-430f-429c-b599-f5cf9017a086 req-1417ff5e-ef62-4be2-96d4-e00ab29ff8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0be10b4-a90b-4509-8de1-a58f29f7b3d6", "name": "network-vif-plugged", "status": "completed", "tag": "746a11a9-951b-434d-8b77-58316be83e90"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:23:57.839403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-b2ae801d-430f-429c-b599-f5cf9017a086 req-1417ff5e-ef62-4be2-96d4-e00ab29ff8d1 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:57.840164 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-b2ae801d-430f-429c-b599-f5cf9017a086 req-1417ff5e-ef62-4be2-96d4-e00ab29ff8d1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:57.840598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-b2ae801d-430f-429c-b599-f5cf9017a086 req-1417ff5e-ef62-4be2-96d4-e00ab29ff8d1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:57.854641 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-b2ae801d-430f-429c-b599-f5cf9017a086 req-1417ff5e-ef62-4be2-96d4-e00ab29ff8d1 service nova] Creating event network-vif-plugged:746a11a9-951b-434d-8b77-58316be83e90 for instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 on hv-cinder-84932 Aug 24 16:23:57.860664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-b2ae801d-430f-429c-b599-f5cf9017a086 req-1417ff5e-ef62-4be2-96d4-e00ab29ff8d1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238092 Aug 24 16:23:57.861271 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1959/3882] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:23:58.837001 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:23:58.837612 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:23:58.844977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:58.845461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:58.845896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:58.846608 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:23:58.847062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:23:58.847485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:23:58.985197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:23:58.992995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9926eb24-7b61-49e1-985f-ebd525970e09 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1269 microversion: 2.1 time: 0.160984 Aug 24 16:23:58.993552 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1924/3883] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:23:58 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:24:00.014728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:24:00.015432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:24:00.022668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:00.023153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:00.023591 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:00.024303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:00.024764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:00.025191 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:00.166994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:24:00.176142 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-4a292559-498d-4de1-ad40-d7f287e20e3b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1456 microversion: 2.1 time: 0.166011 Aug 24 16:24:00.176730 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1960/3884] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:24:00 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:24:00.198010 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:24:00.198622 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:24:00.205248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:00.205735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:00.206173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:00.206876 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:00.207336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:00.207801 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:00.345455 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:24:00.353891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b236ec76-2569-4619-9fd4-3e3cabc311fa tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1456 microversion: 2.1 time: 0.159675 Aug 24 16:24:00.354697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1925/3885] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:24:00 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1456 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:24:02.489577 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-f6af200f-72e8-46e7-b45d-2860d87159cd req-ac58d51a-3682-496e-95da-4447b9e605f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0be10b4-a90b-4509-8de1-a58f29f7b3d6", "tag": "746a11a9-951b-434d-8b77-58316be83e90"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:24:02.500899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f6af200f-72e8-46e7-b45d-2860d87159cd req-ac58d51a-3682-496e-95da-4447b9e605f9 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:02.501395 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f6af200f-72e8-46e7-b45d-2860d87159cd req-ac58d51a-3682-496e-95da-4447b9e605f9 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:02.501805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f6af200f-72e8-46e7-b45d-2860d87159cd req-ac58d51a-3682-496e-95da-4447b9e605f9 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:02.513070 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-f6af200f-72e8-46e7-b45d-2860d87159cd req-ac58d51a-3682-496e-95da-4447b9e605f9 service nova] Creating event network-changed:746a11a9-951b-434d-8b77-58316be83e90 for instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 on hv-cinder-84932 Aug 24 16:24:02.518228 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-f6af200f-72e8-46e7-b45d-2860d87159cd req-ac58d51a-3682-496e-95da-4447b9e605f9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094020 Aug 24 16:24:02.518823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1961/3886] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:24:48.015447 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:24:48.016107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:24:48.018152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:24:48.018998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=52 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:24:48.025603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:48.026231 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:48.026703 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:48.027542 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:48.028039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:48.028467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:48.052388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] HTTP exception thrown: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Request method failure captured: Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d HTTP/1.1 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf2_P-qDkWs3NtdhFEeh8ssSBYtGLLfhnly1aa_fkQGNk_WxOmxKJpQiR3yM0DQX6LVLC-Gt4U8nUIdlmel5Ubyw6mmS2FtU1am1KVIhNU7ajUgVMZX0Sy75aWRuOIgzhvop692omcMH9wkGIaOFT7AO-PB0zUvRqlYSqrPftVdCCI Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:24:48.054743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: c058b07c1e9e443ebacbf38b1f13e58b Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.056364 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '61cc3727-a031-4b16-befc-0397d485562d'} Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:24:48.057032 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.058107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.060173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Returning 404 to user: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:24:48.063379 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-24a1e62e-cc97-4814-993f-64e7ea56a4c1 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 404 len: 111 microversion: 2.20 time: 0.051646 Aug 24 16:24:48.064845 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1926/3887] 10.222.0.102 () {60 vars in 1285 bytes} [Wed Aug 24 16:24:48 2022] DELETE /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:24:48.072251 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=28 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:24:48.075188 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=52 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:24:48.080360 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:24:48.081382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 61cc3727-a031-4b16-befc-0397d485562d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:24:48.087898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:48.088649 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:48.088829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:48.089872 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:24:48.090385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:24:48.090891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:24:48.107790 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] HTTP exception thrown: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Request method failure captured: Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d HTTP/1.1 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf2_P-qDkWs3NtdhFEeh8ssSBYtGLLfhnly1aa_fkQGNk_WxOmxKJpQiR3yM0DQX6LVLC-Gt4U8nUIdlmel5Ubyw6mmS2FtU1am1KVIhNU7ajUgVMZX0Sy75aWRuOIgzhvop692omcMH9wkGIaOFT7AO-PB0zUvRqlYSqrPftVdCCI Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:24:48.109857 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: c058b07c1e9e443ebacbf38b1f13e58b Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.111692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '61cc3727-a031-4b16-befc-0397d485562d'} Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:24:48.112327 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. Aug 24 16:24:48.113344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:24:48.116162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Returning 404 to user: Instance 61cc3727-a031-4b16-befc-0397d485562d could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:24:48.117173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a168d10c-c95f-45d1-80c7-809004ef5bd6 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d" status: 404 len: 111 microversion: 2.20 time: 0.048018 Aug 24 16:24:48.118350 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1962/3888] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:24:48 2022] GET /compute/v2.1/servers/61cc3727-a031-4b16-befc-0397d485562d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:24:55.255115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-bae091a4-d8f5-4dd5-8e94-6680d43f506d tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Action: 'create', calling method: .version_select at 0x7fc5cc864f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-74420899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdC6sQtCS1PouHpBnNxcDf3svu7/r6ITj+HQWw5Ho3VyDQNvI3jj3eRIikljHjwx6ozVj+YQQLVjy935/wPlMTX2MqXzFJPVm+R10JMBSsBHe9XHO+tJLwkzDQv3iEmOA=="}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:24:55.272592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-bae091a4-d8f5-4dd5-8e94-6680d43f506d tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Getting quotas for project 2d68315b538141f8b89af80186a5ff5c. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:24:55.276879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-bae091a4-d8f5-4dd5-8e94-6680d43f506d tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Getting quotas for user e685baf05298436a95e9879edf5c91e4 and project 2d68315b538141f8b89af80186a5ff5c. Resources: {'key_pairs'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:24:55.308070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-bae091a4-d8f5-4dd5-8e94-6680d43f506d tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.230406 Aug 24 16:24:55.308588 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1927/3889] 10.222.0.102 () {60 vars in 1164 bytes} [Wed Aug 24 16:24:55 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:25:13.673954 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1729023915", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-74420899", "security_groups": [{"name": "tempest-secgroup-smoke-1428177911"}], "networks": [{"uuid": "1f429de7-af00-443b-93fc-1874c0a96592"}], "block_device_mapping_v2": [{"uuid": "fd8ff325-1a13-4f79-968d-c396e82faa3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:25:13.683768 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:13.684405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:13.794151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] validate_networks() for [('1f429de7-af00-443b-93fc-1874c0a96592', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:25:14.269894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:25:14.270321 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:25:14.270798 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:25:14.271207 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:25:14.271619 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:25:14.280491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:14.280975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:14.281409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:14.283034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:14.283756 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:14.284165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:14.301218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Getting quotas for project 2d68315b538141f8b89af80186a5ff5c. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:25:14.305593 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Getting quotas for user e685baf05298436a95e9879edf5c91e4 and project 2d68315b538141f8b89af80186a5ff5c. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:25:14.362942 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:25:14.365129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd8ff325-1a13-4f79-968d-c396e82faa3f',volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:25:14.494168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e4a7f56a-8f0b-4b09-9573-ce8f3827e768 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.824803 Aug 24 16:25:14.494797 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1963/3890] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 16:25:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 16:25:14.503177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:14.504014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=4 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:14.504795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:14.509889 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6a2868de-a139-4139-a703-7a2e41be6d92 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:14.510502 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6a2868de-a139-4139-a703-7a2e41be6d92 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:14.812279 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6a2868de-a139-4139-a703-7a2e41be6d92 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:14.820000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6a2868de-a139-4139-a703-7a2e41be6d92 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1090 microversion: 2.1 time: 0.318027 Aug 24 16:25:14.820567 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1928/3891] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:14 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1090 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:25:15.841611 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:15.842257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:15.849223 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:15.849722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:15.850159 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:15.850941 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:15.851405 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:15.851878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:15.916386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:15.925675 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-1f48c6d1-ae97-4ee5-ada7-05ac7186c931 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1206 microversion: 2.1 time: 0.088598 Aug 24 16:25:15.926814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1964/3892] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:15 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1206 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:16.946347 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:16.946958 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:16.953384 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:16.953898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:16.954484 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:16.955203 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:16.955678 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:16.956104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:17.098692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:17.106421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d2d73dea-2e74-4169-be71-20f9b3cef107 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.164011 Aug 24 16:25:17.106980 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1929/3893] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:16 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:17.249784 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-12f45b23-f19a-4afb-b5eb-acba3f9b2f40 req-f1f54c62-2875-4858-95c6-685952bad514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:25:17.261173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-12f45b23-f19a-4afb-b5eb-acba3f9b2f40 req-f1f54c62-2875-4858-95c6-685952bad514 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:17.261747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-12f45b23-f19a-4afb-b5eb-acba3f9b2f40 req-f1f54c62-2875-4858-95c6-685952bad514 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:17.262391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-12f45b23-f19a-4afb-b5eb-acba3f9b2f40 req-f1f54c62-2875-4858-95c6-685952bad514 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:17.274394 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-12f45b23-f19a-4afb-b5eb-acba3f9b2f40 req-f1f54c62-2875-4858-95c6-685952bad514 service nova] Creating event network-changed:3a687fce-17e6-49df-b981-9f8ab65b6417 for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb on hv-cinder-84932 Aug 24 16:25:17.279396 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-12f45b23-f19a-4afb-b5eb-acba3f9b2f40 req-f1f54c62-2875-4858-95c6-685952bad514 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040004 Aug 24 16:25:17.280061 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1965/3894] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:25:18.129007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:18.129706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:18.136173 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:18.136673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:18.137093 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:18.137793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:18.138248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:18.138673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:18.276977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:18.288005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-0f55adfb-8309-4a4f-b27f-8f8196abf2aa tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.163521 Aug 24 16:25:18.288589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1930/3895] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:18 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:25:19.309700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:19.310429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:19.316645 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:19.317129 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:19.317572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:19.318269 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:19.318728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:19.319157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:19.454275 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:19.461877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-54761fce-5849-482b-8f07-66e3a163f4e4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.156912 Aug 24 16:25:19.462432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1966/3896] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:19 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:20.483053 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:20.483601 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:20.490462 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:20.490933 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:20.491361 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:20.492080 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:20.492526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:20.492944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:20.629043 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:20.636774 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d4131672-5845-4fec-bc5a-f5fa22f95d0f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.157634 Aug 24 16:25:20.637332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1931/3897] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:20 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:21.658459 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:21.659084 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:21.665467 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:21.665949 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:21.666386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:21.667076 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:21.667530 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:21.667980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:21.797691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:21.805379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2329cf16-d097-439d-a457-7b019f147a43 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.151648 Aug 24 16:25:21.806168 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1967/3898] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:21 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:22.826432 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:22.827104 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:22.834202 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:22.834691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:22.835131 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:22.835864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:22.836319 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:22.836741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:22.976546 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:22.985177 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-44cb1a1b-dca9-4595-a93b-71b9a84175cd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.162383 Aug 24 16:25:22.985775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1932/3899] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:22 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:24.007430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:24.008064 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:24.014712 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:24.015199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:24.015671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:24.016432 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:24.016986 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:24.017413 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:24.149802 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:24.158134 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e920a6f1-ae6c-4170-bd9a-2374f3f5bf6f tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.154487 Aug 24 16:25:24.158691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1968/3900] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:24 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:24.178438 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:25:24.178615 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:25:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:25:25.178925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:25.179534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:25.181896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:25.187262 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:25.188487 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:25.188959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:25.189675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:25.190126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:25.190570 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:25.326098 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:25.333824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-09ba0fd0-0e2d-440e-91d6-a07a21d14f79 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.158787 Aug 24 16:25:25.334386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1933/3901] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:25 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:26.355498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:26.356452 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:26.359026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:26.359774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:26.366543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:26.367088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:26.367614 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:26.368441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:26.368991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:26.369481 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:26.509873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:26.519484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bf87be83-fef0-4979-9a80-d1c6d22b7ae4 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.168338 Aug 24 16:25:26.532147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1969/3902] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:26 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:27.540661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:27.541302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:27.547899 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:27.548442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:27.548903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:27.549668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:27.550126 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:27.550578 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:27.683442 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:27.691070 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-22c3dd1c-9533-4004-ad4a-0c9cd210f542 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.154541 Aug 24 16:25:27.691621 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1934/3903] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:27 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:28.051975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-b15db14f-39f8-4808-a438-deab825a75aa req-ae5b5995-806c-4d8b-b68a-7e7179664359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "name": "network-vif-plugged", "status": "completed", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:25:28.065359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-b15db14f-39f8-4808-a438-deab825a75aa req-ae5b5995-806c-4d8b-b68a-7e7179664359 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:28.065961 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-b15db14f-39f8-4808-a438-deab825a75aa req-ae5b5995-806c-4d8b-b68a-7e7179664359 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:28.066470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-b15db14f-39f8-4808-a438-deab825a75aa req-ae5b5995-806c-4d8b-b68a-7e7179664359 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:28.078792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-b15db14f-39f8-4808-a438-deab825a75aa req-ae5b5995-806c-4d8b-b68a-7e7179664359 service nova] Creating event network-vif-plugged:3a687fce-17e6-49df-b981-9f8ab65b6417 for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb on hv-cinder-84932 Aug 24 16:25:28.083921 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-b15db14f-39f8-4808-a438-deab825a75aa req-ae5b5995-806c-4d8b-b68a-7e7179664359 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Aug 24 16:25:28.084877 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1970/3904] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:25:28.712068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:28.712797 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:28.719446 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:28.720031 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:28.720471 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:28.721170 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:28.721626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:28.722049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:28.861301 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:28.868915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1c62767b-bec8-4be9-8789-2b45847d0852 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.160894 Aug 24 16:25:28.869474 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1935/3905] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:28 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:29.892150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:29.892746 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:29.898807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:29.899294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:29.899769 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:29.900441 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:29.900890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:29.901316 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:30.036412 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:30.044300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a01f3260-d19d-4a5b-9679-1df64331a2f8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1262 microversion: 2.1 time: 0.157622 Aug 24 16:25:30.044871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1971/3906] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:29 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:31.064811 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:31.065389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:31.072592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:31.073088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:31.073531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:31.074241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:31.074704 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:31.075136 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:31.217574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:31.228515 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-40596713-d6bb-4f48-8f49-6ac06dae0a83 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1447 microversion: 2.1 time: 0.167663 Aug 24 16:25:31.229084 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1936/3907] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:31 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:25:31.248865 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:25:31.249488 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:25:31.256409 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:31.256905 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:31.257345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:31.258045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:31.258506 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:31.258935 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:31.402833 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:25:31.410959 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2a43f42a-a347-4985-a4d2-a31e8eec2d7e tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1447 microversion: 2.1 time: 0.165892 Aug 24 16:25:31.411529 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1972/3908] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:25:31 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:33.088721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-c00937c4-b4cd-434d-9e95-6d552d41612d req-949f220c-0e58-4fe4-b58b-9bfd2759cdea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:25:33.099921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c00937c4-b4cd-434d-9e95-6d552d41612d req-949f220c-0e58-4fe4-b58b-9bfd2759cdea service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:25:33.100402 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c00937c4-b4cd-434d-9e95-6d552d41612d req-949f220c-0e58-4fe4-b58b-9bfd2759cdea service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:25:33.100836 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-c00937c4-b4cd-434d-9e95-6d552d41612d req-949f220c-0e58-4fe4-b58b-9bfd2759cdea service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:25:33.112978 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-c00937c4-b4cd-434d-9e95-6d552d41612d req-949f220c-0e58-4fe4-b58b-9bfd2759cdea service nova] Creating event network-changed:3a687fce-17e6-49df-b981-9f8ab65b6417 for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb on hv-cinder-84932 Aug 24 16:25:33.118686 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-c00937c4-b4cd-434d-9e95-6d552d41612d req-949f220c-0e58-4fe4-b58b-9bfd2759cdea service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034024 Aug 24 16:25:33.119522 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1937/3909] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:26:11.462430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:11.463032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:11.465557 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.466401 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=48 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.472788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:11.473306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:11.473742 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:11.474434 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:11.474888 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:11.475308 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:11.501146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:26:11.577427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-18befd07-1627-46a1-a574-fe86ede38e6d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "DELETE /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 204 len: 0 microversion: 2.1 time: 0.118589 Aug 24 16:26:11.578259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1973/3910] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:26:11 2022] DELETE /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:11.586563 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:11.587297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:11.589961 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=22 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.590560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=50 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.597895 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:11.598399 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:11.598860 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:11.599564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:11.600094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:11.600525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:11.734658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:11.743218 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b60b9a0e-8915-4e33-81d2-a380cc458aa4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1581 microversion: 2.1 time: 0.160887 Aug 24 16:26:11.743824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1938/3911] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:11 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1581 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:12.765245 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:12.765938 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:12.773081 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:12.773562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:12.773994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:12.774676 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:12.775131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:12.775544 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:12.927010 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:12.934668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-bc56d6ab-ba23-410f-a5e5-67e1d61406f2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1581 microversion: 2.1 time: 0.173664 Aug 24 16:26:12.935230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1974/3912] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:12 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1581 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:13.956718 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:13.957333 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:13.963968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:13.964711 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:13.965147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:13.965839 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:13.966293 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:13.966728 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:14.100348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:14.108620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d9ba42a9-a6df-45e0-8792-52d46c39f677 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 200 len: 1581 microversion: 2.1 time: 0.155930 Aug 24 16:26:14.109637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1939/3913] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:13 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 1581 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:14.374122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-f599f0ee-c852-43a9-b216-bf1bcceddc0b req-7343cf12-8821-474b-8df5-b9ba29ec4dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0be10b4-a90b-4509-8de1-a58f29f7b3d6", "name": "network-vif-deleted", "tag": "746a11a9-951b-434d-8b77-58316be83e90"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:26:14.385635 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f599f0ee-c852-43a9-b216-bf1bcceddc0b req-7343cf12-8821-474b-8df5-b9ba29ec4dd1 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:14.386123 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f599f0ee-c852-43a9-b216-bf1bcceddc0b req-7343cf12-8821-474b-8df5-b9ba29ec4dd1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:14.386556 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-f599f0ee-c852-43a9-b216-bf1bcceddc0b req-7343cf12-8821-474b-8df5-b9ba29ec4dd1 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:14.400282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-f599f0ee-c852-43a9-b216-bf1bcceddc0b req-7343cf12-8821-474b-8df5-b9ba29ec4dd1 service nova] Creating event network-vif-deleted:746a11a9-951b-434d-8b77-58316be83e90 for instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 on hv-cinder-84932 Aug 24 16:26:14.406702 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-f599f0ee-c852-43a9-b216-bf1bcceddc0b req-7343cf12-8821-474b-8df5-b9ba29ec4dd1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036180 Aug 24 16:26:14.407498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1975/3914] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:26:15.133263 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:15.133864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:15.147491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:15.148020 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:15.148458 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:15.149169 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:15.149623 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:15.150049 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:15.164940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] HTTP exception thrown: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Request method failure captured: Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 HTTP/1.1 Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBlBo6FfWJW8Y4NtuP9E1wSj-ecs4DjVmcGLEn1T0-nfIIldyLtEaT-r0LSins9jp30LIcS5ucbiumVN9ZhS69WFi9iKj-LK8Lh-1Iitlk-gIf4MgMUfZKs5GUd9sAU6KcDX91y5Bu8j-u4EHAshKZIvsJ6_-nA_EPF8WhvInSSiAeRY Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:26:15.166626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: fe64f798929444dd838825dc0d2700cf Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:26:15.167974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'b0be10b4-a90b-4509-8de1-a58f29f7b3d6'} Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:26:15.168702 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:26:15.170926 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:26:15.172182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Returning 404 to user: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:26:15.172182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-32bcc017-35b0-40a9-a39e-724b72a7a2ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 404 len: 111 microversion: 2.1 time: 0.039071 Aug 24 16:26:15.172182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1940/3915] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:15 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:26:15.286267 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-361979998", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1077735100", "security_groups": [{"name": "tempest-secgroup-smoke-1436962510"}], "block_device_mapping_v2": [{"uuid": "c2964478-783e-418d-b3ea-3ec7a8cb542a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daf6163c-a505-4b53-a37d-44f3eecad956"}]}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:26:15.409757 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.network.neutron [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] validate_networks() for [('daf6163c-a505-4b53-a37d-44f3eecad956', None, None, None, None, None)] {{(pid=132517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:26:15.795858 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Flavor limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:26:15.796293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Image limits 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:26:15.796774 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Flavor pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:26:15.797218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Image pref 0:0:0 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:26:15.797636 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.virt.hardware [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:26:15.806953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:15.807436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:15.807980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:15.808739 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:15.809199 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:15.809625 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:15.826356 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:26:15.830440 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.quota [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for user fe64f798929444dd838825dc0d2700cf and project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'cores', 'instances', 'ram'} {{(pid=132517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:26:15.888239 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Going to run 1 instances... {{(pid=132517) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:26:15.890498 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2964478-783e-418d-b3ea-3ec7a8cb542a',volume_size=None,volume_type=None)] {{(pid=132517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:26:16.021487 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d64a9fb0-8968-46a8-8350-7e4c06b330ff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.739748 Aug 24 16:26:16.022127 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1976/3916] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 16:26:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 16:26:16.033026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-fe15a8b7-3564-443e-a877-40c4faa3cb79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:16.033636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-fe15a8b7-3564-443e-a877-40c4faa3cb79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:16.090386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-fe15a8b7-3564-443e-a877-40c4faa3cb79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:16.097921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-fe15a8b7-3564-443e-a877-40c4faa3cb79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1097 microversion: 2.1 time: 0.069042 Aug 24 16:26:16.098483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1941/3917] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:16 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1097 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:17.120854 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:17.121386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:17.128904 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:17.129495 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:17.129867 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:17.130540 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:17.131258 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:17.131519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:17.196193 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:17.203830 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5f7c17e7-c510-4cf9-81a8-f134ed2fc8a5 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1213 microversion: 2.1 time: 0.088483 Aug 24 16:26:17.204398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1977/3918] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:17 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:18.226068 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:18.227348 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:18.234720 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:18.235210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:18.235856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:18.236418 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:18.236901 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:18.238183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:18.383189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:18.391267 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4264902a-f2fb-46ee-b332-7c4355bda1e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.169616 Aug 24 16:26:18.391864 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1942/3919] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:18 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:18.440527 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-74da0e13-c61e-4682-ae95-c14ff1ba6d6f req-d44af43e-b499-45f7-b7f9-1e13e20b2d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b6ea38-1e61-41fd-9895-141003de18e1", "tag": "57d42c06-0e41-4fbc-81fc-85349db07e74"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:26:18.451672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-74da0e13-c61e-4682-ae95-c14ff1ba6d6f req-d44af43e-b499-45f7-b7f9-1e13e20b2d70 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:18.452155 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-74da0e13-c61e-4682-ae95-c14ff1ba6d6f req-d44af43e-b499-45f7-b7f9-1e13e20b2d70 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:18.452617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-74da0e13-c61e-4682-ae95-c14ff1ba6d6f req-d44af43e-b499-45f7-b7f9-1e13e20b2d70 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:18.465778 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-74da0e13-c61e-4682-ae95-c14ff1ba6d6f req-d44af43e-b499-45f7-b7f9-1e13e20b2d70 service nova] Creating event network-changed:57d42c06-0e41-4fbc-81fc-85349db07e74 for instance 08b6ea38-1e61-41fd-9895-141003de18e1 on hv-cinder-84932 Aug 24 16:26:18.470688 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-74da0e13-c61e-4682-ae95-c14ff1ba6d6f req-d44af43e-b499-45f7-b7f9-1e13e20b2d70 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034287 Aug 24 16:26:18.471279 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1978/3920] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:26:19.413248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:19.413882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:19.422540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:19.423036 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:19.423479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:19.424214 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:19.425388 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:19.426391 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:19.566661 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:19.575311 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-98afeadf-f491-4cbc-9617-84db9d15bece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.166582 Aug 24 16:26:19.575906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1943/3921] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:19 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:20.598303 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:20.598999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:20.605195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:20.605677 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:20.606119 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:20.606805 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:20.607262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:20.607717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:20.754552 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:20.762296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a353e425-a313-4801-ad08-e5c5fc4483e1 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.168745 Aug 24 16:26:20.762896 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1979/3922] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:20 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:21.782422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:21.783063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:21.789879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:21.790313 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:21.790742 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:21.791433 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:21.791925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:21.792336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:21.922086 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:21.929934 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8d0c7b4c-7dfc-48cf-891b-d8e73f740486 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.151372 Aug 24 16:26:21.930497 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1944/3923] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:21 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:22.950989 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:22.951601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:22.958889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:22.959372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:22.959848 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:22.960551 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:22.960988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:22.961411 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:23.101407 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:23.109138 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b437dd86-763b-486c-bdf3-b3cf64b65ece tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.162018 Aug 24 16:26:23.109699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1980/3924] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:22 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:24.131210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:24.132165 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:24.138867 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:24.139359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:24.139843 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:24.140541 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:24.140999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:24.141452 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:24.271206 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:24.278793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f9cc29c0-30b0-41a6-b066-b17b6bf80dfd tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.153142 Aug 24 16:26:24.279340 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1945/3925] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:24 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:25.301741 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:25.302346 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:25.308901 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:25.309391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:25.309828 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:25.310538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:25.310988 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:25.311415 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:25.448137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:25.455786 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7576d98f-33a0-4a5a-aa9e-b04fff5fe07e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.158538 Aug 24 16:26:25.456371 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1981/3926] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:25 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:26.478174 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:26.478793 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:26.480692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.485938 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:26.486423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:26.486870 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:26.487572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:26.488058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:26.488483 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:26.636221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:26.644489 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e6fc36c0-9161-4f77-91a6-c9fad136c9fe tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.170250 Aug 24 16:26:26.644996 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1946/3927] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:26 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:27.665598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:27.666216 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:27.669449 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:27.670217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=6 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:27.674819 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:27.675306 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:27.675785 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:27.676490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:27.677603 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:27.678046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:27.814157 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:27.822906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-9fd958bf-eb17-4caf-bdcc-12fdc5917a3f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.161752 Aug 24 16:26:27.823913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1982/3928] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:27 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:28.844952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:28.845569 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:28.852646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:28.853072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:28.853605 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:28.854195 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:28.854648 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:28.855067 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:28.989545 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:28.997587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5e9d212a-bf50-418a-a52b-88625e26da33 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.156410 Aug 24 16:26:28.998139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1947/3929] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:28 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:30.017807 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:30.018433 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:30.025186 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:30.025681 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:30.026126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:30.026839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:30.027292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:30.027754 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:30.158803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:30.166968 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2a730130-001c-4d91-bcd5-8dc40973d3d4 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.152968 Aug 24 16:26:30.167534 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1983/3930] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:30 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:30.300884 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-2640dba7-d0ec-4bbd-afb1-a19b45653d79 req-f0f24df8-6580-4b0b-a1c7-23aea84efb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b6ea38-1e61-41fd-9895-141003de18e1", "name": "network-vif-plugged", "status": "completed", "tag": "57d42c06-0e41-4fbc-81fc-85349db07e74"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:26:30.312089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2640dba7-d0ec-4bbd-afb1-a19b45653d79 req-f0f24df8-6580-4b0b-a1c7-23aea84efb06 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:30.312574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2640dba7-d0ec-4bbd-afb1-a19b45653d79 req-f0f24df8-6580-4b0b-a1c7-23aea84efb06 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:30.313007 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-2640dba7-d0ec-4bbd-afb1-a19b45653d79 req-f0f24df8-6580-4b0b-a1c7-23aea84efb06 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:30.324906 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-2640dba7-d0ec-4bbd-afb1-a19b45653d79 req-f0f24df8-6580-4b0b-a1c7-23aea84efb06 service nova] Creating event network-vif-plugged:57d42c06-0e41-4fbc-81fc-85349db07e74 for instance 08b6ea38-1e61-41fd-9895-141003de18e1 on hv-cinder-84932 Aug 24 16:26:30.330318 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-2640dba7-d0ec-4bbd-afb1-a19b45653d79 req-f0f24df8-6580-4b0b-a1c7-23aea84efb06 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 Aug 24 16:26:30.330942 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1948/3931] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:26:31.188998 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:31.189594 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:31.196948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:31.197436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:31.197874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:31.198592 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:31.199115 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:31.199476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:31.339408 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:31.347666 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-e32e0a6a-0602-403f-b864-68a09e48cd5b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1269 microversion: 2.1 time: 0.162559 Aug 24 16:26:31.348260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1984/3932] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:31 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:32.370062 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:32.370799 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:32.376974 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:32.377464 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:32.377907 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:32.378603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:32.379060 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:32.379491 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:32.517706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:32.525960 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e87dd0c3-dbc6-42e9-965c-54fe7c49fe29 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1456 microversion: 2.1 time: 0.161180 Aug 24 16:26:32.526525 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1949/3933] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:32 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1456 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:32.546072 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:26:32.546773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:26:32.554165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:32.554657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:32.555097 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:32.555835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:32.556296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:32.556762 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:32.689293 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:26:32.697866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-fef8123c-cee5-43d9-9b29-5341befb75ea tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1456 microversion: 2.1 time: 0.155883 Aug 24 16:26:32.698429 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1985/3934] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:26:32 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1456 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:34.298116 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-b3c62ee3-22ab-44aa-8425-61d336c8741e req-586e91d7-0213-412a-95ce-111189378b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b6ea38-1e61-41fd-9895-141003de18e1", "tag": "57d42c06-0e41-4fbc-81fc-85349db07e74"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:26:34.308473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-b3c62ee3-22ab-44aa-8425-61d336c8741e req-586e91d7-0213-412a-95ce-111189378b47 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:26:34.308947 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-b3c62ee3-22ab-44aa-8425-61d336c8741e req-586e91d7-0213-412a-95ce-111189378b47 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:26:34.309374 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-b3c62ee3-22ab-44aa-8425-61d336c8741e req-586e91d7-0213-412a-95ce-111189378b47 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:26:34.321597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-b3c62ee3-22ab-44aa-8425-61d336c8741e req-586e91d7-0213-412a-95ce-111189378b47 service nova] Creating event network-changed:57d42c06-0e41-4fbc-81fc-85349db07e74 for instance 08b6ea38-1e61-41fd-9895-141003de18e1 on hv-cinder-84932 Aug 24 16:26:34.333861 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-b3c62ee3-22ab-44aa-8425-61d336c8741e req-586e91d7-0213-412a-95ce-111189378b47 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039205 Aug 24 16:26:34.334603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1950/3935] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:27:30.521075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:27:30.521652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:30.523851 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.525273 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.532230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:30.532723 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:30.533160 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:30.533852 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:30.534307 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:30.534732 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:30.559835 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.objects.instance [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lazy-loading 'flavor' on Instance uuid 7811b6e6-9ad8-49ea-8290-554623ea38cb {{(pid=132517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:27:30.634692 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0dd76b31-1ec9-470c-9ea8-b7800f973e99 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "POST /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb/action" status: 202 len: 0 microversion: 2.1 time: 0.116442 Aug 24 16:27:30.635093 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1986/3936] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 16:27:30 2022] POST /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:27:30.641129 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=28 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.641951 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=60 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.646922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:30.647879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:30.656532 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:30.657016 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:30.657653 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:30.658430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:30.658820 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:30.659248 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:30.856817 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:30.864756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f7741e4e-bd64-4560-bdc0-e97014fa0d20 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.225312 Aug 24 16:27:30.865315 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1951/3937] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:30 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:31.886873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:31.887562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:31.893709 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:31.894187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:31.894617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:31.895296 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:31.895796 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:31.896220 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:32.090285 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:32.098098 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-f52ff410-3609-4640-8c6b-d9095a62d911 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.216068 Aug 24 16:27:32.098599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1987/3938] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:31 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:33.120238 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:33.120788 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:33.127061 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:33.127538 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:33.128012 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:33.128695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:33.129141 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:33.129560 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:33.268912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:33.277893 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58b26c7b-d71b-4c91-853f-a33e7a1a1b66 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.161658 Aug 24 16:27:33.278565 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1952/3939] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:33 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:34.300253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:34.301253 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:34.308915 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:34.309633 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:34.310075 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:34.310772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:34.311226 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:34.311680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:34.675328 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:34.684977 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c7eb72b9-743c-4c90-94a5-08e867d23afb tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.388806 Aug 24 16:27:34.685541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1988/3940] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:34 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:35.705977 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:35.706564 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:35.714314 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:35.714789 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:35.715473 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:35.716188 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:35.716636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:35.717054 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:35.846290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:35.854747 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-1346adec-47d4-48a6-a438-8ecb8641a840 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.152614 Aug 24 16:27:35.855302 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1953/3941] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:35 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:36.877106 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:36.877735 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:36.884572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:36.884572 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:36.884995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:36.885684 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:36.886137 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:36.886558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:37.029382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:37.037041 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-7f339214-8741-405c-8374-d913f18e2d2b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.163844 Aug 24 16:27:37.037599 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1989/3942] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:36 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:38.061380 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:38.062004 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:38.068730 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:38.069235 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:38.069656 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:38.070353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:38.070804 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:38.071823 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:38.204422 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:38.212107 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c2e13fc3-870f-4544-a1e1-98c0f8519e09 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.156954 Aug 24 16:27:38.212669 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1954/3943] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:38 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:39.233443 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:39.234178 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:39.240728 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:39.241213 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:39.241647 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:39.242341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:39.242799 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:39.243881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:39.378028 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:39.386566 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-654dc470-6531-4a1b-8030-3671538bffdd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.156994 Aug 24 16:27:39.387131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1990/3944] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:39 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:40.409937 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:40.410626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:40.417249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:40.417733 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:40.418193 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:40.418885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:40.419338 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:40.419800 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:40.551461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:40.559161 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-a0e7880c-060a-4e2b-9460-0a5a66e5f7d8 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.154364 Aug 24 16:27:40.559741 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1955/3945] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:40 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:41.579875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:41.580503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:41.587853 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:41.588357 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:41.588804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:41.589508 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:41.589971 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:41.590652 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:41.723875 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:41.731522 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-3301741b-1227-4005-bc63-c23c8a4ef5de tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.155612 Aug 24 16:27:41.732111 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1991/3946] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:41 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:42.753006 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:42.753540 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:42.760412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:42.760891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:42.761325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:42.762008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:42.762460 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:42.762879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:42.897707 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:42.906110 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b68593c3-5abf-4f05-a6d3-7cac5466df0b tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.157256 Aug 24 16:27:42.906668 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1956/3947] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:42 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:43.928538 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:43.929187 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:43.937292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:43.937781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:43.938218 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:43.939019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:43.939477 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:43.939922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:44.086891 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:44.095146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-dcf4456d-14f6-477c-ab0b-6856d40c024c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1573 microversion: 2.1 time: 0.170526 Aug 24 16:27:44.095733 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1992/3948] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:43 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:44.115300 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:27:44.115919 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:44.122844 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:44.123332 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:44.123825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:44.124518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:44.124967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:44.125389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:44.166573 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132518) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:27:44.235967 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [c665b8d4-679d-47d4-9782-40f3eab170d5] AMQP server on 10.222.0.102:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:27:45.243457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [c665b8d4-679d-47d4-9782-40f3eab170d5] Reconnected to AMQP server on 10.222.0.102:5672 via [amqp] client with port 45156. Aug 24 16:27:45.247183 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-242a658a-52d8-46f4-8f47-77f894dcb069 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "POST /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb/action" status: 202 len: 0 microversion: 2.1 time: 1.135747 Aug 24 16:27:45.247832 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1957/3949] 10.222.0.102 () {60 vars in 1283 bytes} [Wed Aug 24 16:27:44 2022] POST /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb/action => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:27:45.256126 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:45.256744 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:45.264596 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:45.265102 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:45.265549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:45.266257 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:45.266717 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:45.267146 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:45.412567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:45.420916 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-6f84b8f8-5c5b-47e4-8f94-56beaa5839ea tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1521 microversion: 2.1 time: 0.168606 Aug 24 16:27:45.423664 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1993/3950] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:45 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:46.442795 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:46.443316 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:46.451650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:46.451650 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:46.452210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:46.452892 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:46.453344 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:46.453770 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:46.543691 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-49c952df-e8ee-4793-95d4-0e8d19ab7b49 req-bbcac054-1e89-4d01-909e-793942c1a546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "name": "network-vif-unplugged", "status": "completed", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:27:46.561581 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-49c952df-e8ee-4793-95d4-0e8d19ab7b49 req-bbcac054-1e89-4d01-909e-793942c1a546 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:46.562083 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-49c952df-e8ee-4793-95d4-0e8d19ab7b49 req-bbcac054-1e89-4d01-909e-793942c1a546 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:46.562554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-49c952df-e8ee-4793-95d4-0e8d19ab7b49 req-bbcac054-1e89-4d01-909e-793942c1a546 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:46.578672 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.compute.server_external_events [req-49c952df-e8ee-4793-95d4-0e8d19ab7b49 req-bbcac054-1e89-4d01-909e-793942c1a546 service nova] Unable to find a host for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb. Dropping event network-vif-unplugged {{(pid=132517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:27:46.579561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-49c952df-e8ee-4793-95d4-0e8d19ab7b49 req-bbcac054-1e89-4d01-909e-793942c1a546 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040931 Aug 24 16:27:46.580364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1994/3951] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 16:27:46.606375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:46.621481 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-32ba0ff7-ec19-4883-ba57-b4e49745a508 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1523 microversion: 2.1 time: 0.182593 Aug 24 16:27:46.623217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1958/3952] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:46 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:27:47.645740 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:47.646359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:47.653290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:47.653781 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:47.654225 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:47.654936 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:47.655382 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:47.655839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:47.797957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:47.806095 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a6215fe9-55fd-48cd-a6f8-03cfeacabdbc tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.164305 Aug 24 16:27:47.806668 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1995/3953] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:47 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:48.828117 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:48.828745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:48.835182 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:48.835695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:48.836139 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:48.836838 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:48.837305 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:48.837735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:48.973626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:48.981257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e3406bca-963c-4f59-b9f8-2aef192fae17 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.157605 Aug 24 16:27:48.981833 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1959/3954] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:48 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:50.001795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:50.002398 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:50.008903 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:50.009383 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:50.009816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:50.010497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:50.010946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:50.011372 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:50.151120 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:50.159221 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0c498d3d-bb43-4a35-9fc6-f170e59c0675 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.161247 Aug 24 16:27:50.159826 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1996/3955] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:49 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:51.182706 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:51.183424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:51.190097 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:51.190580 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:51.191019 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:51.191734 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:51.192197 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:51.192624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:51.327336 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:51.335325 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-56e7554a-415b-4aef-83e4-d1707f7f8922 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.156474 Aug 24 16:27:51.335928 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1960/3956] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:51 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:52.355771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:52.356374 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:52.362843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:52.363323 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:52.363788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:52.364474 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:52.364926 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:52.365347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:52.510051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:52.518274 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-122ed300-29f2-4131-89bc-4200a51f2733 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.166355 Aug 24 16:27:52.518844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1997/3957] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:52 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:53.539583 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:53.540217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:53.546773 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:53.547257 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:53.547725 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:53.548415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:53.548872 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:53.549290 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:53.681632 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:53.689922 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b221caa7-2f4e-4892-bfc7-3b16d55b17a1 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.154124 Aug 24 16:27:53.690470 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1961/3958] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:53 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:54.711665 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:54.712202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:54.719598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:54.720112 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:54.720549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:54.721237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:54.721697 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:54.722122 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:54.857958 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:54.865669 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-899d4ca4-f3e0-434a-ab12-d7a9f2c02c0a tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.158000 Aug 24 16:27:54.866233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1998/3959] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:54 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:55.889659 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:55.890696 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:55.897554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:55.898034 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:55.898461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:55.899147 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:55.899590 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:55.900041 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:56.037415 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:56.045787 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4e026b5d-a9ef-4090-ad92-0475dc6cd294 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.163046 Aug 24 16:27:56.046355 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1962/3960] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:55 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:57.065793 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:57.066414 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:57.072562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:57.073059 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:57.073496 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:57.074967 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:57.075436 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:57.075906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:57.209601 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:57.217804 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e0944fb-79b4-4eb4-bd55-2a69d69128dd tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.155915 Aug 24 16:27:57.218386 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 1999/3961] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:57 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:58.239466 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:58.240039 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:58.247120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:58.247603 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:58.248063 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:58.248756 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:58.249210 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:58.249634 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:58.384810 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:58.393620 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-68340f55-92b2-4b9f-ba5b-a7ec782c2648 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.158086 Aug 24 16:27:58.394187 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1963/3962] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:58 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:27:58.587035 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-e82f94bb-6c3a-4f3d-96c4-316dd6ea9a9b req-66023b14-8fd4-41c5-a200-47e61e585f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "name": "network-vif-plugged", "status": "completed", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:27:58.602617 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e82f94bb-6c3a-4f3d-96c4-316dd6ea9a9b req-66023b14-8fd4-41c5-a200-47e61e585f65 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:58.603094 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e82f94bb-6c3a-4f3d-96c4-316dd6ea9a9b req-66023b14-8fd4-41c5-a200-47e61e585f65 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:58.603520 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-e82f94bb-6c3a-4f3d-96c4-316dd6ea9a9b req-66023b14-8fd4-41c5-a200-47e61e585f65 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:58.617894 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-e82f94bb-6c3a-4f3d-96c4-316dd6ea9a9b req-66023b14-8fd4-41c5-a200-47e61e585f65 service nova] Creating event network-vif-plugged:3a687fce-17e6-49df-b981-9f8ab65b6417 for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb on hv-cinder-84932 Aug 24 16:27:58.624211 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-e82f94bb-6c3a-4f3d-96c4-316dd6ea9a9b req-66023b14-8fd4-41c5-a200-47e61e585f65 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040831 Aug 24 16:27:58.625217 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2000/3963] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:27:59.414828 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:27:59.415485 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:27:59.422518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:59.423009 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:59.423453 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:59.424189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:27:59.424651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:27:59.425088 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:27:59.556595 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:27:59.564955 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c5d73a5c-f92d-46bf-8b18-812d71725217 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1579 microversion: 2.1 time: 0.153976 Aug 24 16:27:59.565526 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1964/3964] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:27:59 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:00.587309 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:00.588046 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:00.590985 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=31 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:00.597344 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:00.597944 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:00.598390 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:00.599107 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:00.599564 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:00.600235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:00.604201 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:00.750165 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:00.758153 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-82f80b49-b5fb-4a4d-a5b4-f2eb876c50f7 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1566 microversion: 2.1 time: 0.175500 Aug 24 16:28:00.758727 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2001/3965] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:00 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:21.329094 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-418278630", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1077735100", "security_groups": [{"name": "tempest-secgroup-smoke-1436962510"}], "block_device_mapping_v2": [{"uuid": "831c48fb-6f29-4a6e-b2f6-d61b61559d9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daf6163c-a505-4b53-a37d-44f3eecad956"}]}} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:28:21.338952 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:21.339879 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:21.447534 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.network.neutron [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] validate_networks() for [('daf6163c-a505-4b53-a37d-44f3eecad956', None, None, None, None, None)] {{(pid=132518) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:28:21.836335 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Flavor limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:28:21.836762 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Image limits 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:28:21.837242 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Flavor pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:28:21.837649 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Image pref 0:0:0 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:28:21.838058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.virt.hardware [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:28:21.848816 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:21.849296 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:21.849726 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:21.850440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:21.850888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:21.851306 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:21.868090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:28:21.872000 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.quota [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Getting quotas for user fe64f798929444dd838825dc0d2700cf and project 1259ac84ae764120b41de4af4b0cdb56. Resources: {'cores', 'instances', 'ram'} {{(pid=132518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:28:21.935743 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Going to run 1 instances... {{(pid=132518) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:28:21.937881 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='831c48fb-6f29-4a6e-b2f6-d61b61559d9a',volume_size=None,volume_type=None)] {{(pid=132518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:28:22.066992 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8e509940-1cb3-4d20-b811-a0023adbfeff tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.741637 Aug 24 16:28:22.067646 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1965/3966] 10.222.0.102 () {60 vars in 1152 bytes} [Wed Aug 24 16:28:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 16:28:22.079176 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-05e217ec-a339-46aa-a383-9f09c0ce050f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:22.080003 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-05e217ec-a339-46aa-a383-9f09c0ce050f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:22.082950 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:22.083380 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=5 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:22.136543 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-05e217ec-a339-46aa-a383-9f09c0ce050f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:22.145045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-05e217ec-a339-46aa-a383-9f09c0ce050f tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1097 microversion: 2.1 time: 0.070503 Aug 24 16:28:22.145618 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2002/3967] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:22 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1097 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:23.166775 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:23.167550 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:23.176090 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:23.176685 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:23.177882 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:23.178763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:23.179236 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:23.179692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:23.252777 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:23.261599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-6c82d0e5-9578-4bbb-a268-6f61474b69f9 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1203 microversion: 2.1 time: 0.099387 Aug 24 16:28:23.262841 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1966/3968] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:23 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:24.283963 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:24.284490 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:24.292073 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:24.292574 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:24.293139 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:24.294088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:24.294558 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:24.294991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:24.435816 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:24.446131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-ef04bef2-7c96-441c-bb7b-86be37c59ff7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.166068 Aug 24 16:28:24.460644 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2003/3969] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:24 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:24.614478 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-4c2d6131-0868-47c9-8f00-b220fb17e332 req-a6657f79-a00b-415f-9250-bd31c23c6601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934409ec-09c7-43ea-837a-779aff29a3a1", "tag": "cc0e54fb-0ac4-4330-9302-6ea5b960cdbe"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:28:24.625072 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-4c2d6131-0868-47c9-8f00-b220fb17e332 req-a6657f79-a00b-415f-9250-bd31c23c6601 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:24.625896 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-4c2d6131-0868-47c9-8f00-b220fb17e332 req-a6657f79-a00b-415f-9250-bd31c23c6601 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:24.626386 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-4c2d6131-0868-47c9-8f00-b220fb17e332 req-a6657f79-a00b-415f-9250-bd31c23c6601 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:24.638081 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-4c2d6131-0868-47c9-8f00-b220fb17e332 req-a6657f79-a00b-415f-9250-bd31c23c6601 service nova] Creating event network-changed:cc0e54fb-0ac4-4330-9302-6ea5b960cdbe for instance 934409ec-09c7-43ea-837a-779aff29a3a1 on hv-cinder-84932 Aug 24 16:28:24.643784 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-4c2d6131-0868-47c9-8f00-b220fb17e332 req-a6657f79-a00b-415f-9250-bd31c23c6601 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Aug 24 16:28:24.645046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1967/3970] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:28:25.467549 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:25.468282 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:25.474747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:25.475233 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:25.475700 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:25.476399 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:25.476847 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:25.477262 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:25.613844 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:25.622256 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-de357220-d151-46ce-bee3-995f8612b8e8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.158808 Aug 24 16:28:25.622843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2004/3971] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:25 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:26.643888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:26.644589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:26.650655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:26.651162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:26.651589 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:26.652944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:26.653449 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:26.653869 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:26.786350 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:26.794991 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e894a0a5-9251-4c96-a2b7-3a0770a80f79 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.155723 Aug 24 16:28:26.795556 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1968/3972] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:26 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:27.815843 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:27.816457 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:27.822912 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:27.823400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:27.823871 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:27.824579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:27.825116 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:27.825814 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:27.968173 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:27.975866 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-30386ad4-881b-475e-810f-8005fe4916bf tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.164045 Aug 24 16:28:27.976430 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2005/3973] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:27 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:28.996089 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:28.996658 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:29.003112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:29.003592 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:29.004058 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:29.004739 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:29.005189 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:29.005610 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:29.135524 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:29.143727 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3cc414e4-47ec-4570-a099-f640ea17ad10 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.151539 Aug 24 16:28:29.144310 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1969/3974] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:28 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:30.165565 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:30.166162 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:30.172671 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:30.173147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:30.173588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:30.174294 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:30.174808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:30.175229 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:30.313680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:30.321332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-807cdf7a-d7fd-45ce-84cb-5bcd8f422d47 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.160269 Aug 24 16:28:30.321899 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2006/3975] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:30 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:31.342681 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:31.343288 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:31.349673 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:31.350144 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:31.350572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:31.351249 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:31.351721 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:31.352145 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:31.487148 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:31.497877 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-f4906de4-779e-4485-b3af-c256c433e141 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.159812 Aug 24 16:28:31.498461 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1970/3976] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:31 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:32.524345 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:32.524933 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:32.527230 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell0:SELECT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:32.533038 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:32.533519 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:32.533948 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:32.534663 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:32.535114 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:32.535536 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:32.671906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:32.679898 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-126f8538-91ae-47c4-a55a-24fe2579810b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.159262 Aug 24 16:28:32.680497 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2007/3977] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:32 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:33.701572 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:33.702157 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:33.704108 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=2 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:33.704766 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell0:SELECT=6 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:33.711297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:33.711809 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:33.712243 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:33.712925 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:33.713375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:33.713796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:33.848577 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:33.857467 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-60047530-741a-4577-959f-1463f9e6d1b3 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.159860 Aug 24 16:28:33.858027 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1971/3978] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:33 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:34.777765 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [req-d77f5d91-8737-4665-b26c-e898feb99649 req-9f08c8dd-1f5d-40c1-b8f0-218b5e0d9424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934409ec-09c7-43ea-837a-779aff29a3a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc0e54fb-0ac4-4330-9302-6ea5b960cdbe"}]} {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:28:34.788000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-d77f5d91-8737-4665-b26c-e898feb99649 req-9f08c8dd-1f5d-40c1-b8f0-218b5e0d9424 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:34.788484 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-d77f5d91-8737-4665-b26c-e898feb99649 req-9f08c8dd-1f5d-40c1-b8f0-218b5e0d9424 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:34.789156 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [req-d77f5d91-8737-4665-b26c-e898feb99649 req-9f08c8dd-1f5d-40c1-b8f0-218b5e0d9424 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:34.800747 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.compute.server_external_events [req-d77f5d91-8737-4665-b26c-e898feb99649 req-9f08c8dd-1f5d-40c1-b8f0-218b5e0d9424 service nova] Creating event network-vif-plugged:cc0e54fb-0ac4-4330-9302-6ea5b960cdbe for instance 934409ec-09c7-43ea-837a-779aff29a3a1 on hv-cinder-84932 Aug 24 16:28:34.805749 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [req-d77f5d91-8737-4665-b26c-e898feb99649 req-9f08c8dd-1f5d-40c1-b8f0-218b5e0d9424 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Aug 24 16:28:34.806362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2008/3979] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:28:34.879917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:34.880539 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:34.887077 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:34.888051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:34.888051 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:34.888755 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:34.889208 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:34.889636 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:35.028769 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:35.037740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-732951c0-87f5-47fa-a388-2930fdacf8d7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.163358 Aug 24 16:28:35.038499 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1972/3980] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:34 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:36.059379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:36.060130 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:36.066772 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:36.067255 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:36.067722 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:36.068424 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:36.068907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:36.069331 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:36.206657 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:36.213764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f2054f4-c3b4-4f51-8a2c-4f9a5b0cadf7 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1269 microversion: 2.1 time: 0.159119 Aug 24 16:28:36.214324 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2009/3981] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:36 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:37.234536 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:37.235154 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:37.242475 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:37.242966 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:37.243397 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:37.244115 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:37.244568 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:37.244998 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:37.376005 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:37.383745 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-9d085515-384c-4480-9463-7b1fce8b0d77 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1457 microversion: 2.1 time: 0.153003 Aug 24 16:28:37.384308 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1973/3982] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:37 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1457 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:37.403808 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:28:37.404347 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:28:37.410889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:37.411375 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:37.411850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:37.412541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:37.412994 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:37.413417 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:37.549492 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:28:37.557244 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a070054b-3905-4ad7-86c8-69793a33550b tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1457 microversion: 2.1 time: 0.158004 Aug 24 16:28:37.557811 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2010/3983] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:28:37 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:28:39.188152 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-56feb64f-1b8a-478d-890a-338f90f64fbc req-029f36b7-1a29-4d22-9e95-48d0197ec9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934409ec-09c7-43ea-837a-779aff29a3a1", "tag": "cc0e54fb-0ac4-4330-9302-6ea5b960cdbe"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:28:39.197813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-56feb64f-1b8a-478d-890a-338f90f64fbc req-029f36b7-1a29-4d22-9e95-48d0197ec9cd service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:28:39.198297 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-56feb64f-1b8a-478d-890a-338f90f64fbc req-029f36b7-1a29-4d22-9e95-48d0197ec9cd service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:28:39.198735 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-56feb64f-1b8a-478d-890a-338f90f64fbc req-029f36b7-1a29-4d22-9e95-48d0197ec9cd service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:28:39.213675 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-56feb64f-1b8a-478d-890a-338f90f64fbc req-029f36b7-1a29-4d22-9e95-48d0197ec9cd service nova] Creating event network-changed:cc0e54fb-0ac4-4330-9302-6ea5b960cdbe for instance 934409ec-09c7-43ea-837a-779aff29a3a1 on hv-cinder-84932 Aug 24 16:28:39.219959 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-56feb64f-1b8a-478d-890a-338f90f64fbc req-029f36b7-1a29-4d22-9e95-48d0197ec9cd service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036212 Aug 24 16:28:39.220627 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1974/3984] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:28:43.495385 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:28:43.495922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:28:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:28:44.186648 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:28:44.186953 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:29:23.254693 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:29:23.255396 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:23.256250 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=48 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:23.256446 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:29:23.258654 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=20 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:23.259683 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=44 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:23.269366 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:23.269861 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:23.270850 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:23.272125 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:23.272571 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:23.273002 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:23.300014 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:29:23.350375 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-0279222b-93c8-4939-b96e-1df4179e3ea3 req-7899aa9e-1b0e-473d-adc8-18ffeeb412a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:29:23.360551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-0279222b-93c8-4939-b96e-1df4179e3ea3 req-7899aa9e-1b0e-473d-adc8-18ffeeb412a7 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:23.360963 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-0279222b-93c8-4939-b96e-1df4179e3ea3 req-7899aa9e-1b0e-473d-adc8-18ffeeb412a7 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:23.361417 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-0279222b-93c8-4939-b96e-1df4179e3ea3 req-7899aa9e-1b0e-473d-adc8-18ffeeb412a7 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:23.372957 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-0279222b-93c8-4939-b96e-1df4179e3ea3 req-7899aa9e-1b0e-473d-adc8-18ffeeb412a7 service nova] Creating event network-changed:3a687fce-17e6-49df-b981-9f8ab65b6417 for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb on hv-cinder-84932 Aug 24 16:29:23.378862 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-0279222b-93c8-4939-b96e-1df4179e3ea3 req-7899aa9e-1b0e-473d-adc8-18ffeeb412a7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124896 Aug 24 16:29:23.379898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1975/3985] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:29:23.385920 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-844aef23-6129-4125-a056-906bc445a555 tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "DELETE /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 204 len: 0 microversion: 2.1 time: 0.134889 Aug 24 16:29:23.386777 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2011/3986] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:29:23 2022] DELETE /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:29:23.396476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:29:23.397225 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:29:23.403607 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:23.404140 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:23.405130 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:23.406014 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:23.406476 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:23.406897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:23.546587 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:29:23.554346 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-c3320677-4e4e-4543-8b28-e002c1b5ecab tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.162350 Aug 24 16:29:23.554917 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1976/3987] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:29:23 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:29:24.577516 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:29:24.578332 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:29:24.585018 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:24.585503 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:24.586074 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:24.586771 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:24.587235 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:24.587680 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:24.724067 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:29:24.731881 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5159fef9-9258-4168-9352-33b131bd574c tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1572 microversion: 2.1 time: 0.159267 Aug 24 16:29:24.733194 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2012/3988] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:29:24 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:29:25.754147 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:29:25.754874 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:29:25.761152 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:25.761887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:25.762379 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:25.763086 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:25.763541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:25.764286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:25.813454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-237fbf34-4844-429f-a9ee-402b0e8ddcee req-03e1983d-5d7e-4230-bfc4-820d422c4e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7811b6e6-9ad8-49ea-8290-554623ea38cb", "name": "network-vif-deleted", "tag": "3a687fce-17e6-49df-b981-9f8ab65b6417"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:29:25.829680 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-237fbf34-4844-429f-a9ee-402b0e8ddcee req-03e1983d-5d7e-4230-bfc4-820d422c4e59 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:25.830185 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-237fbf34-4844-429f-a9ee-402b0e8ddcee req-03e1983d-5d7e-4230-bfc4-820d422c4e59 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:25.830626 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-237fbf34-4844-429f-a9ee-402b0e8ddcee req-03e1983d-5d7e-4230-bfc4-820d422c4e59 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:25.836878 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e685baf05298436a95e9879edf5c91e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d68315b538141f8b89af80186a5ff5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:29:25.847917 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8c7aebfa-7eb3-40f0-b5ae-ccf6898a65ba tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 200 len: 1385 microversion: 2.1 time: 0.097800 Aug 24 16:29:25.848761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2013/3989] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:29:25 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 1385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:29:25.854023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-237fbf34-4844-429f-a9ee-402b0e8ddcee req-03e1983d-5d7e-4230-bfc4-820d422c4e59 service nova] Creating event network-vif-deleted:3a687fce-17e6-49df-b981-9f8ab65b6417 for instance 7811b6e6-9ad8-49ea-8290-554623ea38cb on hv-cinder-84932 Aug 24 16:29:25.860128 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-237fbf34-4844-429f-a9ee-402b0e8ddcee req-03e1983d-5d7e-4230-bfc4-820d422c4e59 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117821 Aug 24 16:29:25.860916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1977/3990] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:29:26.869248 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:29:26.869745 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] [instance: 7811b6e6-9ad8-49ea-8290-554623ea38cb] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:29:26.876979 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:26.877448 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:26.877883 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:26.878580 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:29:26.879032 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:29:26.879458 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:29:26.893761 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] HTTP exception thrown: Instance 7811b6e6-9ad8-49ea-8290-554623ea38cb could not be found. Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Request method failure captured: Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb HTTP/1.1 Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBlDRmGZDILdiFLnpDRVTDK9lj25en4UceiTyQl_RlTz3AaPGg82l6GWRJT5rpTJJdvWAWjfAt4nBG_i_NGA7NUpEhM4_-u7jfNkQmmSW1Ed4ok5n_5NVP6OJSTdR5k6M9xxCjCcYLCczCfdgj_NmKewn8AIUj7LWkKGxSVy-OEXXXtQ Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: 2d68315b538141f8b89af80186a5ff5c Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-TestShelveInstance-138274974 Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:29:26.895569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2d68315b538141f8b89af80186a5ff5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2d68315b538141f8b89af80186a5ff5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2d68315b538141f8b89af80186a5ff5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2d68315b538141f8b89af80186a5ff5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-TestShelveInstance-138274974 Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: 2d68315b538141f8b89af80186a5ff5c Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-TestShelveInstance-138274974 Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-TestShelveInstance-138274974-project Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: e685baf05298436a95e9879edf5c91e4 Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-TestShelveInstance-138274974-project Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 7811b6e6-9ad8-49ea-8290-554623ea38cb could not be found. Aug 24 16:29:26.897788 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '7811b6e6-9ad8-49ea-8290-554623ea38cb'} Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7811b6e6-9ad8-49ea-8290-554623ea38cb could not be found. Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:29:26.898809 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7811b6e6-9ad8-49ea-8290-554623ea38cb could not be found. Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7811b6e6-9ad8-49ea-8290-554623ea38cb could not be found. Aug 24 16:29:26.900260 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:29:26.901834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Returning 404 to user: Instance 7811b6e6-9ad8-49ea-8290-554623ea38cb could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:29:26.901834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a16fa65b-cf0c-444a-b12a-70703da8c2ac tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb" status: 404 len: 111 microversion: 2.1 time: 0.032299 Aug 24 16:29:26.901834 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2014/3991] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:29:26 2022] GET /compute/v2.1/servers/7811b6e6-9ad8-49ea-8290-554623ea38cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:29:27.062240 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-7c56e644-9b4b-4dfb-9e63-c9c2fcc7979d tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] Calling method '.version_select at 0x7fc5cc8d6790>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:29:27.082163 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-7c56e644-9b4b-4dfb-9e63-c9c2fcc7979d tempest-TestShelveInstance-138274974 tempest-TestShelveInstance-138274974-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-74420899" status: 202 len: 0 microversion: 2.1 time: 0.024673 Aug 24 16:29:27.082740 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1978/3992] 10.222.0.102 () {58 vars in 1253 bytes} [Wed Aug 24 16:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-74420899 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:30:07.742044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:07.742595 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:07.744887 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:07.745454 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-1a50b76a-5298-443c-8c5a-94909e105dd2 req-4bceff51-5244-4989-9efb-d668d46f1cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934409ec-09c7-43ea-837a-779aff29a3a1", "tag": "cc0e54fb-0ac4-4330-9302-6ea5b960cdbe"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:30:07.745889 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:07.752551 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=10 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:07.753773 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:07.753905 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:07.754292 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:07.754714 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:07.755421 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:07.755929 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:07.756397 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:07.760655 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-1a50b76a-5298-443c-8c5a-94909e105dd2 req-4bceff51-5244-4989-9efb-d668d46f1cb0 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:07.761162 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-1a50b76a-5298-443c-8c5a-94909e105dd2 req-4bceff51-5244-4989-9efb-d668d46f1cb0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:07.761574 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-1a50b76a-5298-443c-8c5a-94909e105dd2 req-4bceff51-5244-4989-9efb-d668d46f1cb0 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:07.775343 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-1a50b76a-5298-443c-8c5a-94909e105dd2 req-4bceff51-5244-4989-9efb-d668d46f1cb0 service nova] Creating event network-changed:cc0e54fb-0ac4-4330-9302-6ea5b960cdbe for instance 934409ec-09c7-43ea-837a-779aff29a3a1 on hv-cinder-84932 Aug 24 16:30:07.780434 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-1a50b76a-5298-443c-8c5a-94909e105dd2 req-4bceff51-5244-4989-9efb-d668d46f1cb0 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039383 Aug 24 16:30:07.782767 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1979/3993] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:07.787270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:30:07.874034 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-a7cf9b04-6682-4c69-96eb-f6471c487368 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "DELETE /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 204 len: 0 microversion: 2.1 time: 0.136379 Aug 24 16:30:07.874873 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2015/3994] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:30:07 2022] DELETE /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:30:07.884651 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:07.885372 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:07.893046 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:07.893544 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:07.894217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:07.895035 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:07.895506 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:07.895949 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:08.038763 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:30:08.046617 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-d8df6ef3-dde4-483d-8beb-0d032eb711ee tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1581 microversion: 2.1 time: 0.166292 Aug 24 16:30:08.047652 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1980/3995] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:07 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1581 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:30:09.068286 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:09.068982 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:09.075393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:09.075907 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:09.076337 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:09.077019 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:09.077471 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:09.077890 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:09.215195 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:30:09.223999 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-feb4b2a4-76a5-467f-8d42-00a5f743d9b8 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1581 microversion: 2.1 time: 0.159912 Aug 24 16:30:09.224567 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2016/3996] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:09 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1581 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:10.188479 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-82f88888-cf4b-4131-b052-5b91d423d867 req-ecf62582-5946-4574-a77f-b4ec9357cd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934409ec-09c7-43ea-837a-779aff29a3a1", "name": "network-vif-deleted", "tag": "cc0e54fb-0ac4-4330-9302-6ea5b960cdbe"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:30:10.198968 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-82f88888-cf4b-4131-b052-5b91d423d867 req-ecf62582-5946-4574-a77f-b4ec9357cd3a service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:10.199566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-82f88888-cf4b-4131-b052-5b91d423d867 req-ecf62582-5946-4574-a77f-b4ec9357cd3a service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:10.200026 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-82f88888-cf4b-4131-b052-5b91d423d867 req-ecf62582-5946-4574-a77f-b4ec9357cd3a service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:10.213353 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-82f88888-cf4b-4131-b052-5b91d423d867 req-ecf62582-5946-4574-a77f-b4ec9357cd3a service nova] Creating event network-vif-deleted:cc0e54fb-0ac4-4330-9302-6ea5b960cdbe for instance 934409ec-09c7-43ea-837a-779aff29a3a1 on hv-cinder-84932 Aug 24 16:30:10.219272 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-82f88888-cf4b-4131-b052-5b91d423d867 req-ecf62582-5946-4574-a77f-b4ec9357cd3a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034447 Aug 24 16:30:10.220412 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1981/3997] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:30:10.245237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:10.245823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:10.252541 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:10.253030 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:10.253554 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:10.254169 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:10.254620 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:10.255045 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:10.326341 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:30:10.334927 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-74df3c66-f6c6-47ec-ad59-81d93b5d66e0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 200 len: 1228 microversion: 2.1 time: 0.093674 Aug 24 16:30:10.335500 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2017/3998] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:10 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:11.357994 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:11.358690 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 934409ec-09c7-43ea-837a-779aff29a3a1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:11.365965 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:11.366440 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:11.366871 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:11.367547 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:11.368023 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:11.368438 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:11.382050 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] HTTP exception thrown: Instance 934409ec-09c7-43ea-837a-779aff29a3a1 could not be found. Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Request method failure captured: Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 HTTP/1.1 Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBlBo6FfWJW8Y4NtuP9E1wSj-ecs4DjVmcGLEn1T0-nfIIldyLtEaT-r0LSins9jp30LIcS5ucbiumVN9ZhS69WFi9iKj-LK8Lh-1Iitlk-gIf4MgMUfZKs5GUd9sAU6KcDX91y5Bu8j-u4EHAshKZIvsJ6_-nA_EPF8WhvInSSiAeRY Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:30:11.383695 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: fe64f798929444dd838825dc0d2700cf Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 934409ec-09c7-43ea-837a-779aff29a3a1 could not be found. Aug 24 16:30:11.385008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '934409ec-09c7-43ea-837a-779aff29a3a1'} Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934409ec-09c7-43ea-837a-779aff29a3a1 could not be found. Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:30:11.386530 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934409ec-09c7-43ea-837a-779aff29a3a1 could not be found. Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934409ec-09c7-43ea-837a-779aff29a3a1 could not be found. Aug 24 16:30:11.387999 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:11.389112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Returning 404 to user: Instance 934409ec-09c7-43ea-837a-779aff29a3a1 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:30:11.389112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-68a1b90c-5044-403e-8044-797faeb331b0 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1" status: 404 len: 111 microversion: 2.1 time: 0.031330 Aug 24 16:30:11.389112 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1982/3999] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:11 2022] GET /compute/v2.1/servers/934409ec-09c7-43ea-837a-779aff29a3a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:30:14.710069 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:14.710622 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:14.711662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-ed3f383c-780c-482b-940d-1827b444d057 req-b1198412-6e4b-40e0-93f0-25f56aeede4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b6ea38-1e61-41fd-9895-141003de18e1", "tag": "57d42c06-0e41-4fbc-81fc-85349db07e74"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:30:14.716839 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:14.717588 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:14.718154 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:14.718879 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:14.719340 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:14.719795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:14.724322 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ed3f383c-780c-482b-940d-1827b444d057 req-b1198412-6e4b-40e0-93f0-25f56aeede4f service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:14.724916 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ed3f383c-780c-482b-940d-1827b444d057 req-b1198412-6e4b-40e0-93f0-25f56aeede4f service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:14.725697 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-ed3f383c-780c-482b-940d-1827b444d057 req-b1198412-6e4b-40e0-93f0-25f56aeede4f service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:14.737898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-ed3f383c-780c-482b-940d-1827b444d057 req-b1198412-6e4b-40e0-93f0-25f56aeede4f service nova] Creating event network-changed:57d42c06-0e41-4fbc-81fc-85349db07e74 for instance 08b6ea38-1e61-41fd-9895-141003de18e1 on hv-cinder-84932 Aug 24 16:30:14.743419 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-ed3f383c-780c-482b-940d-1827b444d057 req-b1198412-6e4b-40e0-93f0-25f56aeede4f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035553 Aug 24 16:30:14.744217 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1983/4000] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:30:14.749561 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Going to try to terminate instance {{(pid=132517) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:30:14.835995 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-c3c2d63c-eae0-4e2f-ae03-d9a89a681cf2 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "DELETE /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 204 len: 0 microversion: 2.1 time: 0.129894 Aug 24 16:30:14.837051 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2018/4001] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:30:14 2022] DELETE /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:30:14.847593 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:14.849201 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:14.855597 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:14.856281 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:14.856897 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:14.857915 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:14.858531 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:14.859114 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:14.998554 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.policy [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132518) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:30:15.007055 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-58a3137a-129d-4806-9f36-71b28f707232 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1581 microversion: 2.1 time: 0.165598 Aug 24 16:30:15.007625 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1984/4002] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:14 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1581 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:16.029209 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:16.029906 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:16.036913 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:16.037393 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:16.037823 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:16.038501 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:16.038946 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:16.039364 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:16.178259 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:30:16.186131 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-da4de8d2-e263-4dd2-a5f6-1843a5cefa7c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1581 microversion: 2.1 time: 0.161351 Aug 24 16:30:16.186699 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2019/4003] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:16 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1581 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:17.097339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [req-fa2128d6-33fa-4d7f-a9dc-39a03c77ee8e req-9b7e75f9-2e82-4011-aae4-b1f0ded0d453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b6ea38-1e61-41fd-9895-141003de18e1", "name": "network-vif-deleted", "tag": "57d42c06-0e41-4fbc-81fc-85349db07e74"}]} {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:30:17.107213 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-fa2128d6-33fa-4d7f-a9dc-39a03c77ee8e req-9b7e75f9-2e82-4011-aae4-b1f0ded0d453 service nova] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:17.108033 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-fa2128d6-33fa-4d7f-a9dc-39a03c77ee8e req-9b7e75f9-2e82-4011-aae4-b1f0ded0d453 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:17.108691 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [req-fa2128d6-33fa-4d7f-a9dc-39a03c77ee8e req-9b7e75f9-2e82-4011-aae4-b1f0ded0d453 service nova] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:17.126121 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.compute.server_external_events [req-fa2128d6-33fa-4d7f-a9dc-39a03c77ee8e req-9b7e75f9-2e82-4011-aae4-b1f0ded0d453 service nova] Creating event network-vif-deleted:57d42c06-0e41-4fbc-81fc-85349db07e74 for instance 08b6ea38-1e61-41fd-9895-141003de18e1 on hv-cinder-84932 Aug 24 16:30:17.131064 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [req-fa2128d6-33fa-4d7f-a9dc-39a03c77ee8e req-9b7e75f9-2e82-4011-aae4-b1f0ded0d453 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038974 Aug 24 16:30:17.131941 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1985/4004] 10.222.0.102 () {64 vars in 1322 bytes} [Wed Aug 24 16:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:17.207701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:17.208513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:17.219246 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:17.220792 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:17.221238 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:17.222060 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:17.222570 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:17.223000 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:17.291150 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.policy [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe64f798929444dd838825dc0d2700cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1259ac84ae764120b41de4af4b0cdb56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:30:17.299270 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-00a530dd-0a42-45fb-87cf-8b6747aef99e tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 200 len: 1228 microversion: 2.1 time: 0.096075 Aug 24 16:30:17.300476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2020/4005] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:17 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:18.321903 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:18.322624 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: 08b6ea38-1e61-41fd-9895-141003de18e1] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:18.329277 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:18.329824 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:18.330271 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:18.330940 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:18.331401 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:18.331854 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:18.344885 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] HTTP exception thrown: Instance 08b6ea38-1e61-41fd-9895-141003de18e1 could not be found. Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Request method failure captured: Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 HTTP/1.1 Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBlBo6FfWJW8Y4NtuP9E1wSj-ecs4DjVmcGLEn1T0-nfIIldyLtEaT-r0LSins9jp30LIcS5ucbiumVN9ZhS69WFi9iKj-LK8Lh-1Iitlk-gIf4MgMUfZKs5GUd9sAU6KcDX91y5Bu8j-u4EHAshKZIvsJ6_-nA_EPF8WhvInSSiAeRY Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:30:18.346486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: fe64f798929444dd838825dc0d2700cf Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 08b6ea38-1e61-41fd-9895-141003de18e1 could not be found. Aug 24 16:30:18.348021 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '08b6ea38-1e61-41fd-9895-141003de18e1'} Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b6ea38-1e61-41fd-9895-141003de18e1 could not be found. Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:30:18.348911 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b6ea38-1e61-41fd-9895-141003de18e1 could not be found. Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b6ea38-1e61-41fd-9895-141003de18e1 could not be found. Aug 24 16:30:18.350291 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.351529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Returning 404 to user: Instance 08b6ea38-1e61-41fd-9895-141003de18e1 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:30:18.351529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-e32d9748-3953-4a8c-bc53-fff10dba3e60 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1" status: 404 len: 111 microversion: 2.1 time: 0.030191 Aug 24 16:30:18.351529 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1986/4006] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:18 2022] GET /compute/v2.1/servers/08b6ea38-1e61-41fd-9895-141003de18e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:30:18.796922 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:18.797427 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:18.804993 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:18.805470 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:18.805980 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:18.806579 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:18.807026 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:18.807445 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:18.821400 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] HTTP exception thrown: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Request method failure captured: Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: DELETE /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 HTTP/1.1 Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBlBo6FfWJW8Y4NtuP9E1wSj-ecs4DjVmcGLEn1T0-nfIIldyLtEaT-r0LSins9jp30LIcS5ucbiumVN9ZhS69WFi9iKj-LK8Lh-1Iitlk-gIf4MgMUfZKs5GUd9sAU6KcDX91y5Bu8j-u4EHAshKZIvsJ6_-nA_EPF8WhvInSSiAeRY Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:30:18.823088 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: fe64f798929444dd838825dc0d2700cf Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.824359 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': 'b0be10b4-a90b-4509-8de1-a58f29f7b3d6'} Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:30:18.825080 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.826184 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.827362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Returning 404 to user: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:30:18.827362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-b4d93fae-fb52-481a-b2b6-895924423c5d tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "DELETE /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 404 len: 111 microversion: 2.1 time: 0.031499 Aug 24 16:30:18.827362 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2021/4007] 10.222.0.102 () {58 vars in 1244 bytes} [Wed Aug 24 16:30:18 2022] DELETE /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:30:18.834237 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:18.834856 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] [instance: b0be10b4-a90b-4509-8de1-a58f29f7b3d6] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:18.841082 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:18.841796 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:18.842486 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:18.843226 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:18.843781 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:18.844423 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:18.859609 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] HTTP exception thrown: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Request method failure captured: Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 HTTP/1.1 Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBlBo6FfWJW8Y4NtuP9E1wSj-ecs4DjVmcGLEn1T0-nfIIldyLtEaT-r0LSins9jp30LIcS5ucbiumVN9ZhS69WFi9iKj-LK8Lh-1Iitlk-gIf4MgMUfZKs5GUd9sAU6KcDX91y5Bu8j-u4EHAshKZIvsJ6_-nA_EPF8WhvInSSiAeRY Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:30:18.862105 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1259ac84ae764120b41de4af4b0cdb56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 1259ac84ae764120b41de4af4b0cdb56 Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449120686 Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: fe64f798929444dd838825dc0d2700cf Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-TestVolumeBootPattern-1449120686-project Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.863339 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': 'b0be10b4-a90b-4509-8de1-a58f29f7b3d6'} Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:30:18.864087 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. Aug 24 16:30:18.865190 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:18.866221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Returning 404 to user: Instance b0be10b4-a90b-4509-8de1-a58f29f7b3d6 could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:30:18.866221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-94e9c45e-499f-42d9-939f-df70ae429950 tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6" status: 404 len: 111 microversion: 2.1 time: 0.033229 Aug 24 16:30:18.866221 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1987/4008] 10.222.0.102 () {58 vars in 1241 bytes} [Wed Aug 24 16:30:18 2022] GET /compute/v2.1/servers/b0be10b4-a90b-4509-8de1-a58f29f7b3d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:30:20.165737 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-8e8bd4c6-bd0c-47a3-94cc-39929730d20c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] Calling method '.version_select at 0x7fc5cca39b80>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:20.191583 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-8e8bd4c6-bd0c-47a3-94cc-39929730d20c tempest-TestVolumeBootPattern-1449120686 tempest-TestVolumeBootPattern-1449120686-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1077735100" status: 202 len: 0 microversion: 2.1 time: 0.029976 Aug 24 16:30:20.192403 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2022/4009] 10.222.0.102 () {58 vars in 1268 bytes} [Wed Aug 24 16:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1077735100 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:30:48.528848 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:48.529421 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.compute.api [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132518) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:48.531985 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_api:SELECT=18 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:48.532389 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG dbcounter [-] [132518] Writing DB stats nova_cell1:SELECT=26 {{(pid=132518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:48.539888 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:48.540385 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:48.540825 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:48.541537 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:48.541995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:48.542430 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG oslo_concurrency.lockutils [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:48.556812 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.wsgi [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] HTTP exception thrown: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Request method failure captured: Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: request: DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d HTTP/1.1 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept: application/json Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Accept-Encoding: identity Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Connection: close Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Length: 0 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Content-Type: application/json Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Host: 10.222.0.102 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Openstack-System-Scope: None Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: User-Agent: python-urllib3/1.26.11 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Auth-Token: gAAAAABjBkf2_P-qDkWs3NtdhFEeh8ssSBYtGLLfhnly1aa_fkQGNk_WxOmxKJpQiR3yM0DQX6LVLC-Gt4U8nUIdlmel5Ubyw6mmS2FtU1am1KVIhNU7ajUgVMZX0Sy75aWRuOIgzhvop692omcMH9wkGIaOFT7AO-PB0zUvRqlYSqrPftVdCCI Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Id: None Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Domain-Name: None Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Identity-Status: Confirmed Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Is-Admin-Project: True Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Id: default Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Domain-Name: Default Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Role: member,reader Aug 24 16:30:48.558377 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Roles: member,reader Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Id: default Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Domain-Name: Default Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Id: c058b07c1e9e443ebacbf38b1f13e58b Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: method: > Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: exception: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.559921 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: action_args: {'id': '4f595382-be87-4054-8542-60e6dfeba11d'} Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:30:48.560647 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.561902 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.563057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Returning 404 to user: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. {{(pid=132518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:30:48.563057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-3abe6a5e-c57c-40ec-91b0-3b23103ffdf3 tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 404 len: 111 microversion: 2.20 time: 0.034822 Aug 24 16:30:48.563057 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1988/4010] 10.222.0.102 () {60 vars in 1285 bytes} [Wed Aug 24 16:30:48 2022] DELETE /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:30:48.568886 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Calling method '>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:48.569513 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.compute.api [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] [instance: 4f595382-be87-4054-8542-60e6dfeba11d] Fetching instance by UUID {{(pid=132517) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:30:48.571825 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:48.572476 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG dbcounter [-] [132517] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:48.580651 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:48.581151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:48.581598 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:48.582300 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Acquiring lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:48.582764 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:48.583202 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG oslo_concurrency.lockutils [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Lock "a4c1394e-0d00-43a6-95ee-abb5457791d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:48.600729 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.wsgi [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] HTTP exception thrown: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Request method failure captured: Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: request: GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d HTTP/1.1 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept: application/json Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Accept-Encoding: identity Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Connection: close Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Length: 0 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Content-Type: application/json Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Host: 10.222.0.102 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Openstack-System-Scope: None Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: User-Agent: python-urllib3/1.26.11 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Auth-Token: gAAAAABjBkf2_P-qDkWs3NtdhFEeh8ssSBYtGLLfhnly1aa_fkQGNk_WxOmxKJpQiR3yM0DQX6LVLC-Gt4U8nUIdlmel5Ubyw6mmS2FtU1am1KVIhNU7ajUgVMZX0Sy75aWRuOIgzhvop692omcMH9wkGIaOFT7AO-PB0zUvRqlYSqrPftVdCCI Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Id: None Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Domain-Name: None Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Identity-Status: Confirmed Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Is-Admin-Project: True Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Id: default Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Domain-Name: Default Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Role: member,reader Aug 24 16:30:48.602295 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Roles: member,reader Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.102:8080", "publicURL": "http://10.222.0.102:8080/v1/AUTH_0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/0b5c7713b8574a09b7af9ab97b5ecbe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}] Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Id: 0b5c7713b8574a09b7af9ab97b5ecbe1 Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929707340 Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Id: default Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Domain-Name: Default Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Id: c058b07c1e9e443ebacbf38b1f13e58b Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929707340-project Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: method: > Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: exception: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.603803 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: action_args: {'id': '4f595382-be87-4054-8542-60e6dfeba11d'} Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:30:48.604491 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. Aug 24 16:30:48.605587 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: ERROR nova.api.openstack.wsgi Aug 24 16:30:48.606606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] Returning 404 to user: Instance 4f595382-be87-4054-8542-60e6dfeba11d could not be found. {{(pid=132517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:30:48.606606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d06d5e08-fb70-4bd7-9246-2a4aa615f94d tempest-AttachVolumeShelveTestJSON-929707340 tempest-AttachVolumeShelveTestJSON-929707340-project] 10.222.0.102 "GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d" status: 404 len: 111 microversion: 2.20 time: 0.038675 Aug 24 16:30:48.606606 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2023/4011] 10.222.0.102 () {60 vars in 1282 bytes} [Wed Aug 24 16:30:48 2022] GET /compute/v2.1/servers/4f595382-be87-4054-8542-60e6dfeba11d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:30:54.265457 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-5032dda6-0c90-489e-ac8a-630c1ea182a1 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc7e6dc0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:54.324891 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-5032dda6-0c90-489e-ac8a-630c1ea182a1 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/ea22aead-24dc-4c98-a55a-ddcebb777ba3" status: 200 len: 351 microversion: 2.1 time: 0.064015 Aug 24 16:30:54.325482 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1989/4012] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 16:30:54 2022] GET /compute/v2.1/os-volumes/ea22aead-24dc-4c98-a55a-ddcebb777ba3 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:55.711290 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-0f1fea94-63ad-439b-847a-a7dc8f832013 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc774ee0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:55.759376 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-0f1fea94-63ad-439b-847a-a7dc8f832013 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/52df9b34-c3b5-4029-b9b4-6365cd65a3af" status: 200 len: 350 microversion: 2.1 time: 0.051964 Aug 24 16:30:55.759975 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2024/4013] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 16:30:55 2022] GET /compute/v2.1/os-volumes/52df9b34-c3b5-4029-b9b4-6365cd65a3af => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:57.094075 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-4ea1cdc9-e883-4094-a0e4-857c9d64faf8 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc9691f0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.142241 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-4ea1cdc9-e883-4094-a0e4-857c9d64faf8 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/d0bc370f-b72f-41ab-a733-8048a30a25a6" status: 200 len: 351 microversion: 2.1 time: 0.052874 Aug 24 16:30:57.143518 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1990/4014] 10.222.0.102 () {58 vars in 1250 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes/d0bc370f-b72f-41ab-a733-8048a30a25a6 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:57.156755 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-5b0a9a2b-354e-4a82-bb7b-8b8fd987b604 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cca8f790>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.241763 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-5b0a9a2b-354e-4a82-bb7b-8b8fd987b604 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089163 Aug 24 16:30:57.242326 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2025/4015] 10.222.0.102 () {58 vars in 1139 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:57.256122 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-b51b302b-a125-4019-a74f-e5414218f2f4 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc8d6e50>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.337866 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-b51b302b-a125-4019-a74f-e5414218f2f4 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086009 Aug 24 16:30:57.338424 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1991/4016] 10.222.0.102 () {58 vars in 1154 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:57.353701 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2e99aff3-ae98-40ab-ae6c-86d251923dc3 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc86f820>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.439151 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2e99aff3-ae98-40ab-ae6c-86d251923dc3 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089233 Aug 24 16:30:57.440582 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2026/4017] 10.222.0.102 () {58 vars in 1139 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:57.452744 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-03a9b987-0ff4-49e0-a3ae-8cc9668c4320 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc7e6ee0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.535995 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-03a9b987-0ff4-49e0-a3ae-8cc9668c4320 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086835 Aug 24 16:30:57.536566 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1992/4018] 10.222.0.102 () {58 vars in 1172 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:57.550569 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-2994600b-2598-46eb-a3e1-b8d6b46f4d1a tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc916e50>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.635042 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-2994600b-2598-46eb-a3e1-b8d6b46f4d1a tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089084 Aug 24 16:30:57.635656 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2027/4019] 10.222.0.102 () {58 vars in 1175 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:57.648662 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-8359104e-096d-4b78-8039-2702c984b945 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cc985280>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.737912 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-8359104e-096d-4b78-8039-2702c984b945 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091714 Aug 24 16:30:57.738507 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1993/4020] 10.222.0.102 () {58 vars in 1160 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:30:57.751133 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: DEBUG nova.api.openstack.wsgi [None req-d1cd35e7-9c16-403e-b5fe-7bf7ed6d3cf9 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5d12b11f0>' {{(pid=132517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.832991 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO nova.api.openstack.requestlog [None req-d1cd35e7-9c16-403e-b5fe-7bf7ed6d3cf9 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085554 Aug 24 16:30:57.833562 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: [pid: 132517|app: 0|req: 2028/4021] 10.222.0.102 () {58 vars in 1193 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:57.846898 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: DEBUG nova.api.openstack.wsgi [None req-cec2354f-b83c-4b0f-8146-430a4c81b0c7 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] Calling method '.version_select at 0x7fc5cd3ddca0>' {{(pid=132518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:57.933599 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO nova.api.openstack.requestlog [None req-cec2354f-b83c-4b0f-8146-430a4c81b0c7 tempest-VolumesTestJSON-1542884044 tempest-VolumesTestJSON-1542884044-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091261 Aug 24 16:30:57.934164 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: [pid: 132518|app: 0|req: 1994/4022] 10.222.0.102 () {58 vars in 1160 bytes} [Wed Aug 24 16:30:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:31:53.639944 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:31:53.640692 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:32:03.503957 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:32:03.504795 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:32:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:33:45.619924 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:33:45.620513 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:35:13.651359 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:35:13.652120 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:35:23.513237 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:35:23.513842 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:35:24.198829 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:35:24.199044 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:35:41.852813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:35:41.852813 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:35:49.558782 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:35:49.559391 dv-cinder-849325-3-iscsi devstack@n-api.service[132517]: Wed Aug 24 16:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:37:05.629008 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:37:05.629637 dv-cinder-849325-3-iscsi devstack@n-api.service[132518]: Wed Aug 24 16:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!